-- Logs begin at Tue 2021-09-14 21:36:35 UTC, end at Tue 2021-09-14 22:42:42 UTC. -- Sep 14 22:07:14.892436 dv-cinder-808819-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 22:07:14.899899 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 14 22:07:14 2021] *** Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: nodename: dv-cinder-808819-1-iscsi Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: machine: x86_64 Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: clock source: unix Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: pcre jit disabled Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: detected number of CPU cores: 4 Sep 14 22:07:14.902486 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: current working directory: / Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: detected binary path: /usr/bin/uwsgi-core Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: your processes number limit is 47680 Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: your memory page size is 4096 bytes Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: detected max file descriptor number: 2048 Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: lock engine: pthread robust mutexes Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: thunder lock: enabled Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 22:07:14.903106 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 14 22:07:14.953476 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: Python main interpreter initialized at 0x557e720139c0 Sep 14 22:07:14.953476 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: python threads support enabled Sep 14 22:07:14.953476 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: your server socket listen backlog is limited to 100 connections Sep 14 22:07:14.953476 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: your mercy for graceful operations on workers is 90 seconds Sep 14 22:07:14.953848 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 22:07:14.953925 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: *** Operational MODE: preforking *** Sep 14 22:07:14.954221 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: *** uWSGI is running in multiple interpreter mode *** Sep 14 22:07:14.954221 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: spawned uWSGI master process (pid: 73748) Sep 14 22:07:14.954427 dv-cinder-808819-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 14 22:07:14.955294 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: spawned uWSGI worker 1 (pid: 73764, cores: 1) Sep 14 22:07:14.955451 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: spawned uWSGI worker 2 (pid: 73765, cores: 1) Sep 14 22:07:14.960444 dv-cinder-808819-1-iscsi devstack@keystone.service[73748]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 22:07:19.993183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 22:07:19.993183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: from cryptography.utils import int_from_bytes Sep 14 22:07:19.993964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 22:07:19.993964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: from cryptography.utils import int_from_bytes Sep 14 22:07:19.994423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 22:07:19.994423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: from cryptography.utils import int_from_bytes Sep 14 22:07:19.994876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 22:07:19.994876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: from cryptography.utils import int_from_bytes Sep 14 22:07:20.042740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 22:07:20.042917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 22:07:20.043110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] command line args: [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 22:07:20.043381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 22:07:20.043560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ================================================================================ {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 22:07:20.043814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] admin_token = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.044059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] config_dir = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.044247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.044443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] config_source = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.044635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] debug = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.044836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.045079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 22:07:20.045199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.045360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 22:07:20.045430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.045489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] command line args: [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 22:07:20.045612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.045715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 22:07:20.045815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ================================================================================ {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 22:07:20.045926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] admin_token = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_config_append = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046375 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] config_dir = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_dir = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] config_source = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.046900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_file = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] debug = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.047842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_config_append = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_dir = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.048981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_file = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.049955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] publish_errors = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.050980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.051952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] standard_threads = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.052961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] use_journal = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] publish_errors = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] use_json = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] use_stderr = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] use_syslog = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.053916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.054033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.054152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.054265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.054387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.054501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] standard_threads = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.054612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.054724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.054835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.054953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.055077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.055190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.055190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] use_journal = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.055430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.055555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] use_json = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.055670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.055794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] use_stderr = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.055913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] use_syslog = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.056034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 22:07:20.056252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.056949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.057976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.058916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.059944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.060935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.061891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.062996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.063925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.064976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.065924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.066917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.067963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.068932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.069984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.070953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.071899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.072892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.073045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.073123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.073276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.073362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.074973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.075927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.external = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.076977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.password = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] auth.token = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.077941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.078104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.078183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.078363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.078600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.external = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.078835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.079136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.079375 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.079611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.password = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.079709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.079846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] auth.token = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.079971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.080979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.081973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.082960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.083949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.084979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.085967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086288 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.086935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087427 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.087920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.088923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.089002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.089722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.089816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.089969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.090944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.091988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.092991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.093956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.094904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.095863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.096840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.097941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098176 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.098979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.099942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.100907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.101861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.102982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.103933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.104011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.104174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.104269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.104744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.104827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.104981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.105953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.106990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.107931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.108930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.109882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.110840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.111974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] role.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] role.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.112960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] role.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] role.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.113921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.114991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.115961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.116907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.117861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.118852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.119969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.120958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.121925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.122968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.123939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124348 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.124944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.connection = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.125905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.connection = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.126876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.127998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.128990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129068 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.129947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.130026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.130120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 22:07:20.130200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.130417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.130663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.130904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 22:07:20.131084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 22:07:20.159618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.159845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.160066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.160607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.160848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.161080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.168980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.169610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.196891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.197119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.197347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.197587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.252098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.252269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.301704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.301934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.302540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.302783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.451339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.451580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.451984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.452217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.452471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.452698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.454954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.455190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.455415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.455638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.455860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.456079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476473 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.476954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.477098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.477181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.477316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.477397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.477531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.477618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.488913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.489047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.502912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.503659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73764) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 22:07:20.521287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.521484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.521569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 22:07:20.521696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 22:07:20.521863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.522019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 22:07:20.522100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.522218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 22:07:20.522299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.522486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.522578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.522748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.522831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.523005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.523085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.523260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.533909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.533993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.534187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.534269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.534452 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.534547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.534729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.534812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.542829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.542942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.546111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.546197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.546390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.546473 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.546671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.546765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.546954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547321 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.547854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.548987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.575901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.576149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.577518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.577778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.577861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.578063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.582963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.583357 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.583438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.583639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.583722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.583921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.590851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.591135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.591229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.591431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.595532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.595816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.595900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.596096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.596179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.596375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.596478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.596685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.596769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.596943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.597069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.597209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.597351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.597473 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.597629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.597906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.616195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.616501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.616686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.616970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.621522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.622148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.625146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.625541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.625767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.626066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.630518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.631173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.634301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.634775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.638446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.638742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.638965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.639049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.639269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.639364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.639558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.639639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.639836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.641330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.641625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.641933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.658699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.658981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.659262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.659531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.660886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.661180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.661457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.661727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.667282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.668990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.669264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.669687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.671388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.671669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.673710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.673988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.674264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.674541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.674707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.674816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.674973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.675265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.675549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.675838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.688771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.689048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.689326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.689603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.689888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.689973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.690169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.690253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.690454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.690536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.690737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.691018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.691295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.691581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.708718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.710014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.711937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.713382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.715259 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.716715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.716966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.718311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.718575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.718852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.719134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.719925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.720202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.720518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.726305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.727831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.727916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.730213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.731842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.732131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.732550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.732828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.733565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.733859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.734146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.734436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.741892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.742179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.742459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.743436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.743719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.744000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.750768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.751048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.751327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.751601 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.751885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.752257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.752558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73764) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 22:07:20.752649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.752802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.752885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.753979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.754163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.754245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.754433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.754513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.754704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.754982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.755252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.755535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.755809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.756072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73764) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 22:07:20.791504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e720139c0 pid: 73765 (default app) Sep 14 22:07:20.794197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e720139c0 pid: 73764 (default app) Sep 14 22:07:20.795369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04a45-4d91-43ca-84ed-20e16cfbb99f None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:20.795666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04a45-4d91-43ca-84ed-20e16cfbb99f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:20.795950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04a45-4d91-43ca-84ed-20e16cfbb99f None None] PATH_INFO: `/v3` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:20.800139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 792 bytes} [Tue Sep 14 22:07:20 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:29.256163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14b3d-b0be-49b2-8a59-5e55a46b374d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:29.256599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14b3d-b0be-49b2-8a59-5e55a46b374d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:29.256753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14b3d-b0be-49b2-8a59-5e55a46b374d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:29.262448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:29 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:29.268287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:29.268729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:29.268880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:29.299392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 22:07:29.483674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG passlib.handlers.bcrypt [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73765) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 22:07:29.484104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG passlib.handlers.bcrypt [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73765) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 22:07:29.538451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:29.540016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:29.686771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:29.816411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca14b3d-b0be-49b2-8a59-5e55a46b374d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:29.848875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG oslo_db.sqlalchemy.engines [None req-6ca14b3d-b0be-49b2-8a59-5e55a46b374d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 22:07:29.976083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca14b3d-b0be-49b2-8a59-5e55a46b374d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:29.980893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:29.981546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:29.981833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:29.982111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:29.989935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:30.039906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 22:07:30.040258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92831-1b48-4777-b81c-4e823100cffa admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:30.050456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:07:30.057088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:30.071596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9bb82-bee9-4e0d-afbe-caaa4936d6d4 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:30.076632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:30.077716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:30.078007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:30.078286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] PATH_INFO: `/v3/projects/28134749d4e040b88a7f85c383c201c7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:30.079726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] RBAC: Authorizing `identity:get_project(project_id=28134749d4e040b88a7f85c383c201c7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:30.130789 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.common.rbac_enforcer.enforcer [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 22:07:30.131134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70358688-d1e7-4d16-aca9-2494ddd9cb23 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:30.136346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:30 2021] GET /identity/v3/projects/28134749d4e040b88a7f85c383c201c7 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:32.238112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95415e5-3140-4aea-9122-82af983480c3 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:32.238587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95415e5-3140-4aea-9122-82af983480c3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:32.238692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95415e5-3140-4aea-9122-82af983480c3 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:32.243206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:32 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:32.250703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:32.251128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:32.251258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:32.270089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:32.271596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:32.279918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:32.302953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95415e5-3140-4aea-9122-82af983480c3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:32.315067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95415e5-3140-4aea-9122-82af983480c3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:32.319266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216ac2-bbde-4f17-a00d-a9b66d89802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:32.319900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216ac2-bbde-4f17-a00d-a9b66d89802a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:32.320191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216ac2-bbde-4f17-a00d-a9b66d89802a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:32.320504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216ac2-bbde-4f17-a00d-a9b66d89802a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:32.328588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216ac2-bbde-4f17-a00d-a9b66d89802a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:32.330359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216ac2-bbde-4f17-a00d-a9b66d89802a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:32.338846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:32.344485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:32.353062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ffc46-5c50-416f-bd54-cacff7c3ba6b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:32.357587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a2ed8-065b-45f5-a9b6-d4c66b14b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:32.358425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a2ed8-065b-45f5-a9b6-d4c66b14b9be admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:32.358708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a2ed8-065b-45f5-a9b6-d4c66b14b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:32.358987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a2ed8-065b-45f5-a9b6-d4c66b14b9be admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:32.360335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a2ed8-065b-45f5-a9b6-d4c66b14b9be admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:32.362156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a2ed8-065b-45f5-a9b6-d4c66b14b9be admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:32.363665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:32 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:34.553112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5016-92bd-49e7-a7c4-f997ad86ffa0 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.553608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5016-92bd-49e7-a7c4-f997ad86ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.553716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5016-92bd-49e7-a7c4-f997ad86ffa0 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.555408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:34.563286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59c68c-d21f-4586-ba6c-eafbecd3296b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.563725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59c68c-d21f-4586-ba6c-eafbecd3296b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.563971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59c68c-d21f-4586-ba6c-eafbecd3296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.581270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ff59c68c-d21f-4586-ba6c-eafbecd3296b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:34.582425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ff59c68c-d21f-4586-ba6c-eafbecd3296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:34.590388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:34.594581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a63d-a9b0-47fc-8061-6c3535049871 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.594867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a63d-a9b0-47fc-8061-6c3535049871 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.595146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a63d-a9b0-47fc-8061-6c3535049871 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.596861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 6/12] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:34.603736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.604604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.604912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.614891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a63d-a9b0-47fc-8061-6c3535049871 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.622027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:34.623222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:34.626561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a63d-a9b0-47fc-8061-6c3535049871 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.630751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.630976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:34.631513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.631796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.632071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.646915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:34.653684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.654038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:34.655471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:07:34.661407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.662415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34249e-1ebe-482e-aff5-6363e9758d2f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.667342 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.667971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.668253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.668565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.671726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bc4a5-0eff-41f4-879d-03a1047c4a83 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.676188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:34.676293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.676866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.677160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.677445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.677984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:34.678187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:34.678503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:34.680202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:34.680202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:07:34.680202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:07:34.681165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:34.686572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:07:34.692401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.695384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:34.700639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853819-5fc6-4a1a-a261-e417c2c05511 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.701325 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.704976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.705726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.706007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.706279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.707418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:34.709118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:34.710460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cc91-386c-4e12-8460-88ec816e9565 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.710624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:34.715511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.716382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.716783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.717073 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.718868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:34.720781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:34.722494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:34.729668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.740009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49caf-0d05-4519-aee6-77e5ba922559 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.744731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7b369-6c68-42a9-bd26-97072725dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.745539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7b369-6c68-42a9-bd26-97072725dd17 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.745823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7b369-6c68-42a9-bd26-97072725dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.746100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7b369-6c68-42a9-bd26-97072725dd17 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.747323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7b369-6c68-42a9-bd26-97072725dd17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:34.749089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7b369-6c68-42a9-bd26-97072725dd17 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:34.750958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:34.757171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:34.767411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef4ba-9d7f-4519-9edd-d6c4f121ae83 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:34.772044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:34.772766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:34.773061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:34.773344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:34.774188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.domain.id=default, user.id=ff904f2428954da5908fbaf5fc605dce) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:34.774504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:34.775520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:34.775520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:07:34.775520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:07:34.777302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20125b7-ad09-46ec-8a35-186fa2385c18 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:34.787191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1344 bytes} [Tue Sep 14 22:07:34 2021] GET /identity/v3/role_assignments?user.id=ff904f2428954da5908fbaf5fc605dce&scope.domain.id=default&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:37.280646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6500d9-d114-4578-ad42-e78f96b8620c None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.281148 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6500d9-d114-4578-ad42-e78f96b8620c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.281219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6500d9-d114-4578-ad42-e78f96b8620c None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.283442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:37.291083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.292383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.293116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.332752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG passlib.handlers.bcrypt [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73764) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 22:07:37.333507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG passlib.handlers.bcrypt [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73764) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 22:07:37.375204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcf3b-3cfe-443e-aae6-da2e7488d92c None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.375935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcf3b-3cfe-443e-aae6-da2e7488d92c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.376469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcf3b-3cfe-443e-aae6-da2e7488d92c None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.381218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:37.381616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:37.383240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:37.386937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.387458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.387940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.422892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:37.424072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:37.430981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:37.442143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:37.460831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.470351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae418c-7451-44f1-9ff5-235b1d3cbbd1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.481793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.481977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.482935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.483225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.483501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.498917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ed47c-d7d0-4129-b483-a7f3c7301ee5 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.501847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:37.508575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:37.509817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 12/25] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:37.511174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.511979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.512265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.512575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.517368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.529797 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c9bc3-4c7b-4372-834f-3f82507f4ce2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.532433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.534332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:37.546829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.547532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.547818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.548093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.548891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:37.549689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.550916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:37.564736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:07:37.566798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 13/27] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:37.572501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:07:37.572947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.573448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.586233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ebbf-696c-4b2d-8239-e6be861f4af6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.587954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4d980-5132-4bed-ac56-1d6b68e96af6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.602001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.602886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.603168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.603444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.605280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.605848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.605953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.606215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.606494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.607236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:37.607548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.607715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:37.609294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:37.609294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:37.609294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:37.609730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:37 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:37.610204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:37.615519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.625346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd400858-a750-4000-8381-f0166e03a6f4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.637346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:07:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:37.644523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.645336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.645620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.645896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.647213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.648243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.649982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:37.656925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:37.665405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d0c2-85f5-4686-abe3-a6d6144d4748 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.668343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:37.682012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba03e-482d-440a-a25e-e5a86562ac95 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:37.687334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.688451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.689044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.689522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:37.689770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] PATH_INFO: `/v3/domains/default/users/ff904f2428954da5908fbaf5fc605dce/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.690195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:37.690481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:37.690762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:37.691479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.692503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:37.692503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:37.692503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:37.693257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ff904f2428954da5908fbaf5fc605dce, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:37.693717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:37.694673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:37.694673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:07:37.694673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:07:37.697197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68c96-b2df-47e7-9bc4-ec1465e453c2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:38.004258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1383 bytes} [Tue Sep 14 22:07:37 2021] PUT /identity/v3/domains/default/users/ff904f2428954da5908fbaf5fc605dce/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:07:38.006479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ce6c-0aef-4ed4-8aa0-02096019fdef None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.006899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ce6c-0aef-4ed4-8aa0-02096019fdef None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.007292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ce6c-0aef-4ed4-8aa0-02096019fdef None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.012959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 17/32] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:38 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:38.026849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179716cf-79dd-49c4-af88-2f7e50e114fb None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.027281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179716cf-79dd-49c4-af88-2f7e50e114fb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.027676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179716cf-79dd-49c4-af88-2f7e50e114fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.062502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-179716cf-79dd-49c4-af88-2f7e50e114fb None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:38.064281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-179716cf-79dd-49c4-af88-2f7e50e114fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:38.113737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 16/33] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:07:37 2021] POST /identity/v3/projects => generated 301 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:38.184801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:38.235449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:38.317728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db79f6a-2c38-44a1-a4b3-877df34767d4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:38.327336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:38.328078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.328375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.330579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.330579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:38.330730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:38.330730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:38.330730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:38.331584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:38.349511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc541-2be6-4f44-8ffb-be962ce606c1 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.350071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc541-2be6-4f44-8ffb-be962ce606c1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.350071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc541-2be6-4f44-8ffb-be962ce606c1 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.352346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 19/35] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:38.367442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a13ec-413f-4413-85e5-f3d724b01c00 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.367833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a13ec-413f-4413-85e5-f3d724b01c00 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.368019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a13ec-413f-4413-85e5-f3d724b01c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.392739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0e5a13ec-413f-4413-85e5-f3d724b01c00 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:38.393979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0e5a13ec-413f-4413-85e5-f3d724b01c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:38.402423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 20/36] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:38.403583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553bd4-7167-4885-ae22-0256f4597517 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.403875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553bd4-7167-4885-ae22-0256f4597517 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.404331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553bd4-7167-4885-ae22-0256f4597517 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.406078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 21/37] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:38.414666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.415003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.415252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.432411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 17/38] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:07:38 2021] POST /identity/v3/roles => generated 219 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:38.443163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:38.458241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ae958-503a-435d-93aa-2e761cfb61d8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:38.459914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:38.461164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:38.467015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19669e17-82c9-47c8-b72d-795dca641ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:38.467719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19669e17-82c9-47c8-b72d-795dca641ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.468005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19669e17-82c9-47c8-b72d-795dca641ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.468286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19669e17-82c9-47c8-b72d-795dca641ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.469102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19669e17-82c9-47c8-b72d-795dca641ab3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:38.470760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19669e17-82c9-47c8-b72d-795dca641ab3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:38.481269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 22/39] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:38.505528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:38.515787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e36d-aab3-423b-883e-04b172066d57 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:38.520588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:38.521281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:38.521572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:38.521854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:38.523662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:38.523842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:38.523842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:07:38.523842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:07:38.524822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf54012-1a8d-4d17-93bd-3b2ff1b3872c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:38.556456 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 18/40] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:07:38 2021] POST /identity/v3/roles => generated 225 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:38.601804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 23/41] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:07:38 2021] POST /identity/v3/roles => generated 223 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:07:39.078925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7d87-d381-49d5-9579-5eca3f594d6f None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:39.079217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7d87-d381-49d5-9579-5eca3f594d6f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:39.079490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7d87-d381-49d5-9579-5eca3f594d6f None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:39.081291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 19/42] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:39.089023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:39.089318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:39.089600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:39.107595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:39.108821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:39.116222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:39.139428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7d87-d381-49d5-9579-5eca3f594d6f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:39.152076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7d87-d381-49d5-9579-5eca3f594d6f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:39.156335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eebcb0-9b79-4468-9984-0ed88ac604e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:39.157143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eebcb0-9b79-4468-9984-0ed88ac604e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:39.157435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eebcb0-9b79-4468-9984-0ed88ac604e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:39.157720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eebcb0-9b79-4468-9984-0ed88ac604e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:39.158896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eebcb0-9b79-4468-9984-0ed88ac604e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:39.160623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eebcb0-9b79-4468-9984-0ed88ac604e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:39.162204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 20/44] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:39.168531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:39.177489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f149-bfcd-4a8c-8308-b17c53ab72dd None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:39.181840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:39.182489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:39.182777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:39.183058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:39.183773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:39.184794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:39.184794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:07:39.184794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:07:39.186011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be490-3038-4a27-aa08-f566d74ba402 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:39.277504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 25/45] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:07:39 2021] POST /identity/v3/projects => generated 312 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:40.364967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391224dc-0e9c-4b94-8e74-aea82b202d1a None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.365474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391224dc-0e9c-4b94-8e74-aea82b202d1a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.365546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391224dc-0e9c-4b94-8e74-aea82b202d1a None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.367308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 21/46] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:40.375246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.375654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.375827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.393251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:40.394444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:40.453002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 26/47] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:40.477007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391224dc-0e9c-4b94-8e74-aea82b202d1a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:40.489838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391224dc-0e9c-4b94-8e74-aea82b202d1a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:40.494086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:40.495476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.495764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.496043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.509231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:40.515918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:40.517120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 22/48] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:40.523495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:40.532442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0a42b-eec7-4ad3-afa3-dbb6f196321a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:40.536892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:40.537563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.537857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.538144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.538904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:40.539223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:40.540875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:40.549570 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 27/49] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:40.555654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:40.565832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ac3f1-7499-4fed-af65-38db0f146762 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:40.570137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:40.570985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.571270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.571548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.572765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:40.574561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:40.576100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 23/50] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:40 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:40.581601 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:40.591601 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbed37f-a8b7-4b19-b497-648497a757c0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:40.595922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13d35-199d-42df-ab87-006f61963e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:40.596716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13d35-199d-42df-ab87-006f61963e53 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.597006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13d35-199d-42df-ab87-006f61963e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.597289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13d35-199d-42df-ab87-006f61963e53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.598446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13d35-199d-42df-ab87-006f61963e53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:40.600101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13d35-199d-42df-ab87-006f61963e53 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:40.601666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 28/51] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:40.608327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:40.617455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf93b67-cbd7-4978-a8cc-9b90de2a9f6b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:40.621751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:40.622371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:40.622657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:40.622936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:40.623744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.domain.id=default, user.id=ff904f2428954da5908fbaf5fc605dce) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:40.624054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:40.625067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:40.625067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:40.625067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:40.626207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aee6f-eec9-405c-969a-e1e690bb61f7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:40.633277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 24/52] 10.222.0.20 () {56 vars in 1344 bytes} [Tue Sep 14 22:07:40 2021] GET /identity/v3/role_assignments?user.id=ff904f2428954da5908fbaf5fc605dce&scope.domain.id=default&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:41.407611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671ca9-686d-4f1b-9516-8b269a20c5a7 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:41.408190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671ca9-686d-4f1b-9516-8b269a20c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:41.408190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87671ca9-686d-4f1b-9516-8b269a20c5a7 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:41.410011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 29/53] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:41.417235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:41.417634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:41.417797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:41.435956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:41.437473 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:41.444948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 25/54] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:41.469113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87671ca9-686d-4f1b-9516-8b269a20c5a7 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:41.481640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87671ca9-686d-4f1b-9516-8b269a20c5a7 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:41.485942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278f41a-1254-4645-9575-98e7f1c648e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:41.486718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f41a-1254-4645-9575-98e7f1c648e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:41.487068 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f41a-1254-4645-9575-98e7f1c648e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:41.487404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f41a-1254-4645-9575-98e7f1c648e2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:41.488594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278f41a-1254-4645-9575-98e7f1c648e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:41.490315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278f41a-1254-4645-9575-98e7f1c648e2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:41.491867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 30/55] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:41.497878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:41.506501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d1e3d-4932-4fc9-b5a2-90e794070bc0 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:41.511474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8100-b74a-486c-9f56-a098885be4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:41.512110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8100-b74a-486c-9f56-a098885be4ed admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:41.512395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8100-b74a-486c-9f56-a098885be4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:41.512701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8100-b74a-486c-9f56-a098885be4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:41.513403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8100-b74a-486c-9f56-a098885be4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:41.515276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8100-b74a-486c-9f56-a098885be4ed admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:41.625973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 26/56] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 14 22:07:41 2021] POST /identity/v3/projects => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:43.741143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c520-dd3b-420b-9526-b30c44f178b6 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:43.741682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c520-dd3b-420b-9526-b30c44f178b6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:43.741682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c520-dd3b-420b-9526-b30c44f178b6 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:43.743504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 31/57] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:43.750553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:43.750978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:43.751123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:43.768443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:43.769638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:43.824753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 27/58] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:43.849308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c520-dd3b-420b-9526-b30c44f178b6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:43.861814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c520-dd3b-420b-9526-b30c44f178b6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:43.866054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3561-9f89-4462-9bc3-60db67b5945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:43.866823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3561-9f89-4462-9bc3-60db67b5945d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:43.867111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3561-9f89-4462-9bc3-60db67b5945d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:43.867392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3561-9f89-4462-9bc3-60db67b5945d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:43.868573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3561-9f89-4462-9bc3-60db67b5945d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:43.872522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3561-9f89-4462-9bc3-60db67b5945d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:43.874074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 32/59] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:43.879818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:43.888687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43299072-cd16-4e43-9cd9-619c8a367e90 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:43.893120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:43.893781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:43.894076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:43.894364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:43.895080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:43.896093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:43.896093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:43.896093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:43.897373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54985c5-31cb-440b-b7ab-5788577222b8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:44.011285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 28/60] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:07:43 2021] POST /identity/v3/users => generated 275 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:47.227039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839b6d-db1b-46fd-b275-833a376a3b86 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.228099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839b6d-db1b-46fd-b275-833a376a3b86 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.228648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839b6d-db1b-46fd-b275-833a376a3b86 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.231289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 33/61] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:47.243303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa7ccd-27da-4dc1-9bf8-9f9c35c36ab1 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.244328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa7ccd-27da-4dc1-9bf8-9f9c35c36ab1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.249174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa7ccd-27da-4dc1-9bf8-9f9c35c36ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.273292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d4aa7ccd-27da-4dc1-9bf8-9f9c35c36ab1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:47.274832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d4aa7ccd-27da-4dc1-9bf8-9f9c35c36ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:47.287041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 29/62] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:47.323132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4839b6d-db1b-46fd-b275-833a376a3b86 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.336712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4839b6d-db1b-46fd-b275-833a376a3b86 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.340823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904afd5-a994-437d-ab16-0b202d120940 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.341208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904afd5-a994-437d-ab16-0b202d120940 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.341503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904afd5-a994-437d-ab16-0b202d120940 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.342388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.343290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 30/63] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:47.343493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.343919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.344341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.355827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:47.362935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:47.364705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 34/64] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:47.374332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.375545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.376335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.377070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.391825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388e4d-0777-44b0-abd7-4d9e4bbbf624 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.404593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.405643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.406161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.406641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.407609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:47.408133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.411033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.421474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:47.422989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:47.424618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 35/65] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.427430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.436285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 31/66] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:47.439022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2870-6b98-45a4-9238-b0c50ee3b4e0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.443574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.444473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.444776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.445060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.446262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.448755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.455509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 36/67] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.456870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.465094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.471967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e59cb4-c6d0-4af8-8136-5aa7a7967b28 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.474727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c14e2-177a-47bc-abbc-9d0664d03a92 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.479703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7010c-a1fb-4f15-94c1-dc9dd25b2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.479842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a35237-376c-49a2-bf3b-b25bffb100b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.480522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a35237-376c-49a2-bf3b-b25bffb100b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.480907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a35237-376c-49a2-bf3b-b25bffb100b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.481117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7010c-a1fb-4f15-94c1-dc9dd25b2348 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.481368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a35237-376c-49a2-bf3b-b25bffb100b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.481707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7010c-a1fb-4f15-94c1-dc9dd25b2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.482128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7010c-a1fb-4f15-94c1-dc9dd25b2348 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.498850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a35237-376c-49a2-bf3b-b25bffb100b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.501823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a35237-376c-49a2-bf3b-b25bffb100b8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.506319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7010c-a1fb-4f15-94c1-dc9dd25b2348 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:47.514989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-e2c7010c-a1fb-4f15-94c1-dc9dd25b2348 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:47.516312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 37/68] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:47.517792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f7dc-1ebd-42fc-a83c-0789fd4d90d1 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.518279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f7dc-1ebd-42fc-a83c-0789fd4d90d1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.518753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f7dc-1ebd-42fc-a83c-0789fd4d90d1 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.520911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 38/69] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:47.527720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f7dc-1ebd-42fc-a83c-0789fd4d90d1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.527879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 32/70] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:47.529266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.529813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.530304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.547452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f7dc-1ebd-42fc-a83c-0789fd4d90d1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.549673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:47.551275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:47.551901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.552610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.552902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.553184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.554220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:47.554539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.556174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.561826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 33/71] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:47.563029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.572726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 39/72] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.576918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd9c9-0b08-4ac1-a8fa-67a7b6742544 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.580541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.583335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.584543 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.585046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.585522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.586917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.589467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.591836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 34/73] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.599068 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f901-db07-48da-be2e-513fbe5d21ba admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.601995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.605561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.606640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.607127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.607579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.615046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17459b-7e57-420f-83fa-9f75699fcd83 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.621271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.622492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.623250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.623703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.624493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.624938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=15970df938b34324ade5c0a6b2e46601, user.id=ff904f2428954da5908fbaf5fc605dce) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:47.625435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.626844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.627640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.628807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 40/74] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:47.634128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 35/75] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/role_assignments?user.id=ff904f2428954da5908fbaf5fc605dce&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.640553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.640716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.658579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7866d1e-ef45-4c9e-bd80-4ef5c75c1ce6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.660246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409b12-ab6a-4e00-ac36-df44b6e1d3d1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.671832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.672925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.673221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.673509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.675506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.676177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.676485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.676771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.691468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.693327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.703595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:47.719575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:07:47.721569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 41/76] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:47.726494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 36/77] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:07:47.738083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.748691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.760495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6325b8-04cc-4209-a7b5-bbf3eaf9ff42 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.763783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780351-e07f-42d4-93d1-21a56f01d3de admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.770654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.771349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.771643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.771930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.772740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:47.773060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.774084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:47.774084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:47.774084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:47.775004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.778788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.779675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.779967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.780262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.783615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.785803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.792862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 42/78] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.794092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.805157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 37/79] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:47.814291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.816960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9667c97-052b-4e19-b2d2-c942c7d1b1e7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.829792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.830088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca87a-8197-4ead-8460-311ee0f5e142 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.831062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.831545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.832050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.833158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] RBAC: Adding query filter params (role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=15970df938b34324ade5c0a6b2e46601, user.id=2acd590566f84548b72e8db4e6dd1038) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:47.833754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.835929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.842675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 43/80] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/role_assignments?user.id=2acd590566f84548b72e8db4e6dd1038&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:47.844253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.845192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.845485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.845773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.847808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.852476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.852476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 38/81] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:47.859023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.870866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b65cf-125a-46aa-b763-d64e0d3030cd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.875914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.876904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.877446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.877927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.888210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.890567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.901481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 44/82] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:47.908397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.926617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252e0d-70f5-4954-aafd-457c8b8392d5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.941362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27cb95-90b7-4d94-ae4c-821d1bad6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.942271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cb95-90b7-4d94-ae4c-821d1bad6385 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.942569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cb95-90b7-4d94-ae4c-821d1bad6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.942858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cb95-90b7-4d94-ae4c-821d1bad6385 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.944283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cb95-90b7-4d94-ae4c-821d1bad6385 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.946487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cb95-90b7-4d94-ae4c-821d1bad6385 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.948925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 39/83] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:47.955615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:47.966100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfd56f-51db-4545-9133-d4ad3e6068cc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:47.976632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:47.977780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:47.978312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:47.978825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:47.980172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] RBAC: Adding query filter params (role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=15970df938b34324ade5c0a6b2e46601, user.id=2acd590566f84548b72e8db4e6dd1038) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:47.980743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:47.982974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab993c-0e24-4de9-8996-6dc7ca7cf075 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:47.996062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 45/84] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:47 2021] GET /identity/v3/role_assignments?user.id=2acd590566f84548b72e8db4e6dd1038&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:48.012530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e667a-cda7-4b58-8a9b-6a29244d032b None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.012854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e667a-cda7-4b58-8a9b-6a29244d032b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.013119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e667a-cda7-4b58-8a9b-6a29244d032b None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.015201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 40/85] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:48.024901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.025932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.026741 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.051200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:48.052915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:48.057529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563c336-6397-4191-93a3-6fd6b16c4f88 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.057894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563c336-6397-4191-93a3-6fd6b16c4f88 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.058189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563c336-6397-4191-93a3-6fd6b16c4f88 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.060049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 41/86] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:48.065125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 46/87] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:48.077786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.078103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.078364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.090249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.105692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7c1f-c6ba-4a5b-884d-304dcf04aa0b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.113114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:48.113114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:48.116991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.117818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.118113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.118399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.120576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.122329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.125463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 47/88] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:48.129588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 42/89] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:48.132111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.149537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a9774-cc9c-4932-915c-e7c2ad48a6c9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.157158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.157330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.158271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.158764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.159260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.160530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.162959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.171193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80667329-3a2f-4467-853d-0e186e8303c5 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.181042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.182594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.183056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.183188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.198041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:48.205947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:48.207791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 43/90] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:07:48.215143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.225996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e9704-e4f7-4ecd-9476-26c4b559364a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.231806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.242420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.242913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.247992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.247992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:48.247992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.247992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.256884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 44/91] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:48.278576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 48/92] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:07:48 2021] POST /identity/v3/projects => generated 302 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:48.279734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.292462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b7c6-084f-42e5-b216-391b05ee66af admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.357121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.358532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.359069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.359612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.361095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.363738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.365988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 45/93] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:48.373514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.390049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c959e7d-a80b-4679-8bc7-fdd1fbf1dc2d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.397321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.398964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.399820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.400696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.412267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.415448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.426236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 49/94] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:48.433463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.444304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24509-0db7-4a9a-a9c4-2b26661ff7d8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.449394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca634e4-1ae8-4859-9f9a-acad3c7b4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.450581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca634e4-1ae8-4859-9f9a-acad3c7b4d22 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.451073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca634e4-1ae8-4859-9f9a-acad3c7b4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.451549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca634e4-1ae8-4859-9f9a-acad3c7b4d22 admin admin] PATH_INFO: `/v3/projects/e4769bc444274e8586e4a57e7480ac20` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.453006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca634e4-1ae8-4859-9f9a-acad3c7b4d22 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4769bc444274e8586e4a57e7480ac20)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.455290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca634e4-1ae8-4859-9f9a-acad3c7b4d22 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.457255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 46/95] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/projects/e4769bc444274e8586e4a57e7480ac20 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:48.471142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:48.481922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73d348-bf08-4dd6-9cd9-6be5c76b0c42 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:48.490578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:48.491720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:48.492210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:48.492765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:48.493886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] RBAC: Adding query filter params (role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=e4769bc444274e8586e4a57e7480ac20, user.id=2acd590566f84548b72e8db4e6dd1038) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:48.494958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:48.497197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24f293-45f2-4c5b-bca3-75600734e1cc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:48.505966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:48 2021] GET /identity/v3/role_assignments?user.id=2acd590566f84548b72e8db4e6dd1038&scope.project.id=e4769bc444274e8586e4a57e7480ac20&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:50.288661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28ca8-648a-4c7f-a95e-3208175daa77 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.289669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28ca8-648a-4c7f-a95e-3208175daa77 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.290221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28ca8-648a-4c7f-a95e-3208175daa77 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.292463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 47/97] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:50.300656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.301615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.302120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.329576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:50.331163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:50.339635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 51/98] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:50.365582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56294-5534-4ff2-adc8-758de7e7d6dc None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.366206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56294-5534-4ff2-adc8-758de7e7d6dc None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.366690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56294-5534-4ff2-adc8-758de7e7d6dc None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.368695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 48/99] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:50.374589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.383765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28286e8-fc88-4e6f-8f1f-7499ca3da38f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.388591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.389111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.389770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.395596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.396679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.398778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.399265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.422724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:50.423030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:50.424455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:50.429832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:50.436441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 52/100] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:50.438078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.439513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:50.449097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2426-f90c-4e60-aaef-9eaee8e3c12b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.453978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.454724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.455017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.455298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.456093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:50.456407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.458170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.469225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:50.475762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.476080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.486484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167a9f-8098-44b9-8859-edfdcb621173 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.490880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fc49-ff78-428c-a24a-988119303d57 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.491080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.491828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.496443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.496443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.503336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:50.505178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.506281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.506783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.507268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.508703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.510864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:50.511685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.512412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 54/103] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:50.513728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 50/104] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:50.518387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.533781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d0cab-dcdf-4e00-ae74-56453db7a582 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.534672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.541904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.542328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.542670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.542954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.543713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:50.544143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.545774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06ba9-516b-4eae-b5ff-f411176319b1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.546909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176da311-1346-407c-a4e0-a4b19be83118 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.551654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.552764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.553338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.553825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.555204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.555831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 55/105] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:50.557715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.559595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 51/106] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:50.561240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e005c0-5bf3-484f-91e7-c73be155105e None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.561735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e005c0-5bf3-484f-91e7-c73be155105e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.562213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e005c0-5bf3-484f-91e7-c73be155105e None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.564085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 56/107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:50 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:50.565088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.568152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e005c0-5bf3-484f-91e7-c73be155105e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.576146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd54ca-c844-46e6-bb39-f29f8fd076e8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.580830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54271950-a9ec-4417-885f-e94a6d34ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.581800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54271950-a9ec-4417-885f-e94a6d34ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.582189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54271950-a9ec-4417-885f-e94a6d34ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.582567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54271950-a9ec-4417-885f-e94a6d34ed02 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.583272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e005c0-5bf3-484f-91e7-c73be155105e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.583954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54271950-a9ec-4417-885f-e94a6d34ed02 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.586522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54271950-a9ec-4417-885f-e94a6d34ed02 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.588949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 52/108] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:50.589233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.590270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.590577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.590725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.591104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.591334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.591758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601/users/ff904f2428954da5908fbaf5fc605dce/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.594487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970df938b34324ade5c0a6b2e46601, user_id=ff904f2428954da5908fbaf5fc605dce, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.597788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.610387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:50.611649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:50.620455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 53/109] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:50.621043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.633918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef0067-59b0-406d-89f2-6d89f6484d45 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.638822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.639763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.640054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.640384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.641711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.643886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.646041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:50.646895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.656829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6363-44b4-4f87-b38b-f7cd7ce42007 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.661445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.662207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.662511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.662780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.673743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:50.680802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:07:50.682779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 55/111] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:50.683597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.693879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bba82-b65a-4ca9-877d-99676d027f6d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:50.698538 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:50.699386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:50.699676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:50.699955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601/users/2acd590566f84548b72e8db4e6dd1038/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:50.702051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970df938b34324ade5c0a6b2e46601, user_id=2acd590566f84548b72e8db4e6dd1038, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:50.703058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:50.703058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:07:50.703058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:07:50.705079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:50.870742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 57/112] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:50 2021] PUT /identity/v3/projects/15970df938b34324ade5c0a6b2e46601/users/ff904f2428954da5908fbaf5fc605dce/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:07:50.871993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:50.900977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 56/113] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:50 2021] PUT /identity/v3/projects/15970df938b34324ade5c0a6b2e46601/users/2acd590566f84548b72e8db4e6dd1038/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:07:50.966016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bd3d0-9926-47c8-91ce-2ceb54cef1d3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.045873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.046641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.046941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.047231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.048018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:51.048338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.050043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20917e5-c959-41bd-bc58-5889fd71d43a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.060756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 58/114] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:07:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:51.069623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.089269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeaf10-37e3-4104-9c08-d3b96f8a393c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.094037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f271fd-64bc-453a-96da-4ca287eeed8e None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.094204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.094699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f271fd-64bc-453a-96da-4ca287eeed8e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.095112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.095364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f271fd-64bc-453a-96da-4ca287eeed8e None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.095459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.095713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.097056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.097920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 59/115] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:51.099377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.101280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:51.107499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.108080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.108617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.108799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.121051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f569b-5b0b-4d2a-a7fa-47d5739e07e1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.127648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.128603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.128896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.129178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.130097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:51.130452 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.131680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:51.132817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.136842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 58/117] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:51.140318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 60/118] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:51.145942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.158161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76828-0515-45c1-b4d9-144710f60813 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.163079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.164099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.164387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.164712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601/users/2acd590566f84548b72e8db4e6dd1038/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.167845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.168204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970df938b34324ade5c0a6b2e46601, user_id=2acd590566f84548b72e8db4e6dd1038, role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.171068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.178352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab346-b1bc-45c9-bd7c-599f9713da74 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.184585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.185654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.188518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.188518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.198447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:51.205589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:51.207028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 61/119] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:07:51.214034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.224712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d6f8-bc6b-4ab7-8de3-fb18be91f765 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.230012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.230906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.231519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.231991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.232952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:51.233460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.235315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.246821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 59/120] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:51 2021] PUT /identity/v3/projects/15970df938b34324ade5c0a6b2e46601/users/2acd590566f84548b72e8db4e6dd1038/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:07:51.247498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:51.254111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.326646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becbc95-58b2-42d1-8ee4-78e75af24673 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.333035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.334290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.334808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.335267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.336878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.340079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.342339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:51.349635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.365384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2f14-060f-4b18-8672-389af44dd1c2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.371564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9b06f-a372-47a8-96c6-d03a15d9d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.372877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b06f-a372-47a8-96c6-d03a15d9d154 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.373374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b06f-a372-47a8-96c6-d03a15d9d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.373832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b06f-a372-47a8-96c6-d03a15d9d154 admin admin] PATH_INFO: `/v3/projects/e4769bc444274e8586e4a57e7480ac20` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.375264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9b06f-a372-47a8-96c6-d03a15d9d154 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4769bc444274e8586e4a57e7480ac20)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.377704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9b06f-a372-47a8-96c6-d03a15d9d154 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.385058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/projects/e4769bc444274e8586e4a57e7480ac20 => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:51.386820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.397848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2a2f-73af-4088-885c-dc7489a0ce78 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.403837 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148705d-4c05-4f44-a7c3-99d7e536eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.405213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148705d-4c05-4f44-a7c3-99d7e536eaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.405704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148705d-4c05-4f44-a7c3-99d7e536eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.406159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148705d-4c05-4f44-a7c3-99d7e536eaf1 admin admin] PATH_INFO: `/v3/projects/e4769bc444274e8586e4a57e7480ac20/users/2acd590566f84548b72e8db4e6dd1038/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.408571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148705d-4c05-4f44-a7c3-99d7e536eaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4769bc444274e8586e4a57e7480ac20, user_id=2acd590566f84548b72e8db4e6dd1038, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.411644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148705d-4c05-4f44-a7c3-99d7e536eaf1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.498625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 61/124] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:51 2021] PUT /identity/v3/projects/e4769bc444274e8586e4a57e7480ac20/users/2acd590566f84548b72e8db4e6dd1038/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:07:51.521144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71c82-8300-4aae-8edb-0ae4fc7ca333 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.521761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71c82-8300-4aae-8edb-0ae4fc7ca333 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.522240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71c82-8300-4aae-8edb-0ae4fc7ca333 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.524374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 64/125] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:51.533533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.534182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.534671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.555686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:51.558008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:51.623416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 62/126] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:51.649791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71c82-8300-4aae-8edb-0ae4fc7ca333 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.663222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71c82-8300-4aae-8edb-0ae4fc7ca333 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.668636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c09579-3fa5-4bcb-afaf-8de24bddf1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.669678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c09579-3fa5-4bcb-afaf-8de24bddf1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.670161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c09579-3fa5-4bcb-afaf-8de24bddf1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.670658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c09579-3fa5-4bcb-afaf-8de24bddf1e6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.672050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c09579-3fa5-4bcb-afaf-8de24bddf1e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.674085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c09579-3fa5-4bcb-afaf-8de24bddf1e6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.676286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:51.683181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:51.692686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb39fbc-e6a1-4df0-aca5-0fc5780b11f1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:51.698141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bac163-c483-49f5-8582-96a57492d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:51.699087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bac163-c483-49f5-8582-96a57492d1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:51.699573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bac163-c483-49f5-8582-96a57492d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:51.700050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bac163-c483-49f5-8582-96a57492d1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:51.701042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bac163-c483-49f5-8582-96a57492d1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:51.703177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bac163-c483-49f5-8582-96a57492d1d7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:51.801100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 63/128] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:07:51 2021] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:53.444850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259136e-099f-4e6a-8ae6-ea5fec0a94e2 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.445413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259136e-099f-4e6a-8ae6-ea5fec0a94e2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.445413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259136e-099f-4e6a-8ae6-ea5fec0a94e2 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.447238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 66/129] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:53.455143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.455607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.455705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.476836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:53.478569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:53.490838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 64/130] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:53.533907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259136e-099f-4e6a-8ae6-ea5fec0a94e2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.547927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259136e-099f-4e6a-8ae6-ea5fec0a94e2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.553910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.554719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.555004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.555289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.568085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:53.575206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:53.576699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:53.583852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.593483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6dc1-7cc9-451d-8efc-48f74692107a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.598324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.599018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.599309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.599594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.600371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:53.600717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.602365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.613093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:53.619998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.630388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d6c8e-7dda-49b9-a529-259da9056e0c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.637965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9410-5b1c-4507-955c-b5152fea3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.638836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9410-5b1c-4507-955c-b5152fea3944 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.639125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9410-5b1c-4507-955c-b5152fea3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.639408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9410-5b1c-4507-955c-b5152fea3944 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.640635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9410-5b1c-4507-955c-b5152fea3944 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.642467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9410-5b1c-4507-955c-b5152fea3944 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.644223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 68/133] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:53.650286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.661131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514882-ae56-4239-a968-0b7cc90673e8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.668063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.668802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.669092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.669372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.678591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2c76a-b59a-43ac-847b-abee579a8b7e None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.678884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2c76a-b59a-43ac-847b-abee579a8b7e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.679172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2c76a-b59a-43ac-847b-abee579a8b7e None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.681046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 69/134] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:53.688459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.688459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.694316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.694614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.694905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.697223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 66/135] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:53.703445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.712489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125279eb-396f-47cb-bb2c-c39fad15ce12 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.722934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.724057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.724573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.725053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.725623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:53.726832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:53.727704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.730807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.732789 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 67/136] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:53.739196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.742185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:53.750252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354af0f-1d24-4ece-932c-91541a7fad48 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.760680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.761595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.762121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.762600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.763631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=15970df938b34324ade5c0a6b2e46601, user.id=ff904f2428954da5908fbaf5fc605dce) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:53.764142 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.766220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.772798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 68/138] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/role_assignments?user.id=ff904f2428954da5908fbaf5fc605dce&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:53.795841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.810859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803eb45-5c6e-48dd-96c1-9bc5480059eb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.820985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.821941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.822291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.822575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.844938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:53.851951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:53.853759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 71/139] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:53.860541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.875028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f49d90-7a3c-4ee5-acf2-7001cb0c4bde admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.888309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.889396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.889984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.890459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.891425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:53.891932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.893787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.903745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:53.910173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.921643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5cca2-8f49-4e09-aa6a-067838dbd360 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.928724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.929627 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.929919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.930261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.931647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.934010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.935742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 72/141] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:53.942271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:53.953835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2b87a-9f90-4e60-84ec-f327d4c1d07d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:53.965879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:53.967079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:53.967577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:53.968059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:53.979526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:53.981762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:53.996953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:54.003208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.018839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03f9b-0544-4ab7-a5c9-321def451e32 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.030203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add740ee-dac5-4ca2-bbd1-21a78f3cbfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.031094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add740ee-dac5-4ca2-bbd1-21a78f3cbfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.031380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add740ee-dac5-4ca2-bbd1-21a78f3cbfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.031668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add740ee-dac5-4ca2-bbd1-21a78f3cbfa9 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.032949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add740ee-dac5-4ca2-bbd1-21a78f3cbfa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.035028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add740ee-dac5-4ca2-bbd1-21a78f3cbfa9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.036965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 73/143] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.044233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.054007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aeb75-eb30-41d5-aad2-ebddbc51dd2b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.062709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.063841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.064329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.064879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.065987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] RBAC: Adding query filter params (role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=15970df938b34324ade5c0a6b2e46601, user.id=2acd590566f84548b72e8db4e6dd1038) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:54.066524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.068865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a2d06-4e8c-47c2-b5f3-d202d746b37b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.076133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/role_assignments?user.id=2acd590566f84548b72e8db4e6dd1038&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.080470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0004-78cd-475e-b7a4-c798030dbe92 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.080470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0004-78cd-475e-b7a4-c798030dbe92 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.080470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0004-78cd-475e-b7a4-c798030dbe92 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.080470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 74/145] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:54.088779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.089404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.089885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.110361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:54.111938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:54.123276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:54.162339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0004-78cd-475e-b7a4-c798030dbe92 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.183118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0004-78cd-475e-b7a4-c798030dbe92 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.189312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.190146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.190439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.190722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.209031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:54.217001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:07:54.218602 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:54.225139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.250620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f16e1-4fd5-43c0-9d9a-19a531b23c82 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.261523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.262594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.263083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.263657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.264706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:54.265218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.267027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.277690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.283796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.301972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa204-a92f-42ed-ac4f-85ff5431a72a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.314233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.315147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.315441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.315729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.317013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.319195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.320947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.327503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.339201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c119-cffb-40fa-93a8-b2fa0b6c9337 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.350152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.351256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.351746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.352340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.365200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.367411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.380029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:54.386460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.409264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9416-a138-4dbf-90bd-ec92400df923 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.415994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df7da-ab0c-4091-8ac3-27ce3c0d0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.416893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df7da-ab0c-4091-8ac3-27ce3c0d0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.417182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df7da-ab0c-4091-8ac3-27ce3c0d0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.417464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df7da-ab0c-4091-8ac3-27ce3c0d0fd7 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.418680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df7da-ab0c-4091-8ac3-27ce3c0d0fd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.420787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df7da-ab0c-4091-8ac3-27ce3c0d0fd7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.422636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.429062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.437907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca91f89-6f2d-4751-8aad-6b9c2dade413 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.438204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca91f89-6f2d-4751-8aad-6b9c2dade413 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.438494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca91f89-6f2d-4751-8aad-6b9c2dade413 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.440269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 78/152] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:07:54.441626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf726-997e-4846-be00-f9bcde0fa21b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.449018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.450016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.450553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.451028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.452058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] RBAC: Adding query filter params (role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=15970df938b34324ade5c0a6b2e46601, user.id=2acd590566f84548b72e8db4e6dd1038) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:54.452610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.454812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.463502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/role_assignments?user.id=2acd590566f84548b72e8db4e6dd1038&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.468636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.469104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.469296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.499205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:54.500459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:54.519086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:54.561703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.572345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad576f1-7745-4748-85ae-dd3e42914ed1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.582393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.583666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.584157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.584672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.606219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:54.613681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:54.615138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:54.621903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.638289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef8e0b-1736-4f45-989b-37ec1c99797a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.654055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.654762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.655069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.655355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.656131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:54.656450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.658083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.673177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 80/156] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.679656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.695894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0919a33-2bfe-4dbf-8412-2c09ebed4e3c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.705102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.706430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.706911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.707424 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.708943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.711404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.713399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 77/157] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.719823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.734100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe89a-c064-4ebe-a6a1-50b529d0fbfc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.745131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.745817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.746106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.746385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.764111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.765979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.778436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 81/158] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:54.785192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.800457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eebbb6-e385-4f88-9240-8245fb98ca45 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.809180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c66b0-bafb-487f-96c4-cbc166687c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.810285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c66b0-bafb-487f-96c4-cbc166687c9d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.810789 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c66b0-bafb-487f-96c4-cbc166687c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.811319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c66b0-bafb-487f-96c4-cbc166687c9d admin admin] PATH_INFO: `/v3/projects/e4769bc444274e8586e4a57e7480ac20` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.812777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c66b0-bafb-487f-96c4-cbc166687c9d admin admin] RBAC: Authorizing `identity:get_project(project_id=e4769bc444274e8586e4a57e7480ac20)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.815107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c66b0-bafb-487f-96c4-cbc166687c9d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.817068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 78/159] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/projects/e4769bc444274e8586e4a57e7480ac20 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:54.824179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:54.837355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d22da-374e-44f3-8ea6-b2ce2b48f435 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:54.844388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:54.845080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:54.845369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:54.845652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:54.846485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] RBAC: Adding query filter params (role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=e4769bc444274e8586e4a57e7480ac20, user.id=2acd590566f84548b72e8db4e6dd1038) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:54.846802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:54.848699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f513c-3d6d-4b36-9be0-83b20b4c36bf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:54.861037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 82/160] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:54 2021] GET /identity/v3/role_assignments?user.id=2acd590566f84548b72e8db4e6dd1038&scope.project.id=e4769bc444274e8586e4a57e7480ac20&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:55.754873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5710815-3a5f-4025-ac34-fc6c572d911c None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.755393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5710815-3a5f-4025-ac34-fc6c572d911c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.755494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5710815-3a5f-4025-ac34-fc6c572d911c None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.757243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 79/161] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:55.764637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.765091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.765284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.783201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:55.784397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:55.792941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:55.817630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5710815-3a5f-4025-ac34-fc6c572d911c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:55.830558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5710815-3a5f-4025-ac34-fc6c572d911c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:55.835168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:55.835975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.836264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.836602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.847607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:55.855167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:55.856369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 80/163] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:55.862781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:55.872564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9e680-b3fd-4f5c-8f13-44245eeb7d77 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:55.877108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:55.877779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.878072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.878351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.879104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:55.879406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:55.881026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:55.889951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:55.896141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:55.906383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37cce-78a0-4046-a730-e7bad7cff6db admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:55.911151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:55.912028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.912309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.912621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.927521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:55.929702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:55.931995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:55 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:55.938085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:55.947974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf6a4d-efea-467a-9add-7111a42e9c08 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:55.952507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:55.953160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.953447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.953724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.961858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:55.963656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:55.972788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:55.979722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:55.989412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e70f-f4c5-4028-b74d-767d17a6cbca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:55.994411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe51f37-ea45-4b6a-9655-a2a65adac945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:55.995259 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe51f37-ea45-4b6a-9655-a2a65adac945 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:55.995544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe51f37-ea45-4b6a-9655-a2a65adac945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:55.995821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe51f37-ea45-4b6a-9655-a2a65adac945 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:55.997030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe51f37-ea45-4b6a-9655-a2a65adac945 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:55.999061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe51f37-ea45-4b6a-9655-a2a65adac945 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.000741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 82/167] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:55 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:56.006970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.015967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d59bb-b63b-4425-9093-967cbc21b6ff admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.020497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.021148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.021432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.021708 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.022539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] RBAC: Adding query filter params (role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=698f287bc6964263ac5a9264981d29cc, user.id=c9ae58b4092f431d9920763647a309c7) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:56.022851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.024759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3ec1-3ec4-4380-864b-aa6eb678c1a9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.030505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/role_assignments?user.id=c9ae58b4092f431d9920763647a309c7&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:56.227830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bdb5-7aae-402c-9ac4-80c15933ab48 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.228719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bdb5-7aae-402c-9ac4-80c15933ab48 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.228951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8bdb5-7aae-402c-9ac4-80c15933ab48 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.231020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 83/169] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:56.239179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.239179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.239179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.261705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:56.262833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:56.270580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:56.296058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bdb5-7aae-402c-9ac4-80c15933ab48 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.308541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8bdb5-7aae-402c-9ac4-80c15933ab48 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.313109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.313893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.314174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.314449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.326421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:56.333253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:56.334530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 84/171] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:56.341420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.350761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ad290-e0c5-4db9-b452-4a2147775157 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.355808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.356646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.357004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.357351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.358182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:56.358564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.360293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.371076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:56.377328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.388606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa455-5ea7-4535-8325-4f6d09f795f3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.393820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.394925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.395365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.395725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.397384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.399598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.401517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:56.407987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.422944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a93d7-8def-41ac-900a-88b40cc68db7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.427924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.428854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.429387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.429880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.439216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.441321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.451391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:56.457617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.469267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341612-061f-41f3-944a-caea3b157564 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.473957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5190a-9c09-443f-8422-6ecce17cd655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.475104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5190a-9c09-443f-8422-6ecce17cd655 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.475605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5190a-9c09-443f-8422-6ecce17cd655 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.476093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5190a-9c09-443f-8422-6ecce17cd655 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.477561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5190a-9c09-443f-8422-6ecce17cd655 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.480193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5190a-9c09-443f-8422-6ecce17cd655 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.482094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 86/175] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:56.488650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.498161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dc5b-3074-4cfa-8c7d-7f3369db6da8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.503101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.504005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.504584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.505113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.506161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=698f287bc6964263ac5a9264981d29cc, user.id=ff904f2428954da5908fbaf5fc605dce) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:56.506670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.508857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aae02c-3be9-413a-9d6c-72e35ac668a0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.515580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 90/176] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/role_assignments?user.id=ff904f2428954da5908fbaf5fc605dce&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:56.829257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04686ce5-5aa2-4cc7-bb3e-fc62b9f59dbb None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.829779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04686ce5-5aa2-4cc7-bb3e-fc62b9f59dbb None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.829853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04686ce5-5aa2-4cc7-bb3e-fc62b9f59dbb None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.831966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 87/177] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:56.840274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.840860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.840860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.860675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:56.861928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:56.870706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:56.894715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04686ce5-5aa2-4cc7-bb3e-fc62b9f59dbb None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.907269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04686ce5-5aa2-4cc7-bb3e-fc62b9f59dbb None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.912143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb0d63-636f-431c-b7ea-df20fffea758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.913049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb0d63-636f-431c-b7ea-df20fffea758 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.913335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb0d63-636f-431c-b7ea-df20fffea758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.913619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb0d63-636f-431c-b7ea-df20fffea758 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.914874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb0d63-636f-431c-b7ea-df20fffea758 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.916609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb0d63-636f-431c-b7ea-df20fffea758 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.918446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 88/179] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:56.924364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:56.933129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ddf1-8dc9-4b86-a131-affaa2dd8406 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.933416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ddf1-8dc9-4b86-a131-affaa2dd8406 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.933696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ddf1-8dc9-4b86-a131-affaa2dd8406 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.934362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5e82d-30c7-419c-97bb-6527b181bcf9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:56.935700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 89/180] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:56.942193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:56.942193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.942193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.942193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] PATH_INFO: `/v3/groups` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.942489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:56.942489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:07:56.942489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:07:56.942489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:07:56.942883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:56.943075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:56.943232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:56.943417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:56.961570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:56.962752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:56.970287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 90/181] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:56.995142 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:57.003866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f33ac2-78e3-4a2c-8b59-de0b43b9ea68 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:57.008588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:57.009068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:57.009869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:57.010145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:57.020065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:57.027284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:07:57.028585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 91/182] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:07:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:07:57.034258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:57.043327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114e53-b076-44f5-bada-90440e5ac43b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:57.047698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:57.048304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:57.048622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:57.048898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:57.049623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:57.049925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:57.051501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:57.061510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 92/183] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:07:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:57.066970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 92/184] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 14 22:07:56 2021] POST /identity/v3/groups => generated 229 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:07:57.068203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:57.079627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bab5a6-ad01-477f-9986-7b5eb81e4b60 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:57.084381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:57.085348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:57.085628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:57.085949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:57.087437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:57.089816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:57.091902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 93/185] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:57 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:57.098105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:57.109182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ef74-54e3-4544-a5f4-d857d24ff065 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:57.114356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:57.115403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:57.115891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:57.116381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:57.126282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:57.128726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:57.140026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 93/186] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:07:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:07:57.146733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:57.157163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9aa8-9b1d-4303-bf22-1860eb08c428 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:57.161719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138c396-811d-4213-9305-360b2b7bc3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:57.162580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c396-811d-4213-9305-360b2b7bc3eb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:57.162917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c396-811d-4213-9305-360b2b7bc3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:57.163193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c396-811d-4213-9305-360b2b7bc3eb admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:57.164459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138c396-811d-4213-9305-360b2b7bc3eb admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:57.167144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138c396-811d-4213-9305-360b2b7bc3eb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:57.169320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 94/187] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:57 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:57.176011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:57.186053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244c62-13d6-4904-ac78-797b1a7b0bda admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:57.190828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:57.191704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:57.192034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:57.192316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:57.193274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] RBAC: Adding query filter params (role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=698f287bc6964263ac5a9264981d29cc, user.id=c9ae58b4092f431d9920763647a309c7) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:57.193585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:57.196126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3995-1868-4ac0-9a6a-a66ce3764ab3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:57.202732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 94/188] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:07:57 2021] GET /identity/v3/role_assignments?user.id=c9ae58b4092f431d9920763647a309c7&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:58.298387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5f1e8-959b-45b2-b60d-a5d2d8ead3ce None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.298927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5f1e8-959b-45b2-b60d-a5d2d8ead3ce None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.298927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5f1e8-959b-45b2-b60d-a5d2d8ead3ce None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.300841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 95/189] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:58.309465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.309969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.310040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.328785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:58.329970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:58.344552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 95/190] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:58.362531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5f1e8-959b-45b2-b60d-a5d2d8ead3ce None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.376178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5f1e8-959b-45b2-b60d-a5d2d8ead3ce None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.380633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.381469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.381755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.382043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.393391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:58.400448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:07:58.401963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 96/191] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:58.408344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.417388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2274e-6ec3-4f01-ab36-eddc2c425335 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.421883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.422556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.422839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.423117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.423876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:58.424189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.425807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.435421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 96/192] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:58.441521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.452391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf00f-4731-44a0-823e-e91c8bb46ea0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.456860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.457684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.457965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.458243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.459429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.461580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.463218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 97/193] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:58.469187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.478822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2745af-bf31-47c0-a7bf-cb865e935579 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.483451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1dfb5-e93f-48d8-aa88-4db4e25a380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.484298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dfb5-e93f-48d8-aa88-4db4e25a380d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.484611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dfb5-e93f-48d8-aa88-4db4e25a380d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.484886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dfb5-e93f-48d8-aa88-4db4e25a380d admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.486074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1dfb5-e93f-48d8-aa88-4db4e25a380d admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.488144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1dfb5-e93f-48d8-aa88-4db4e25a380d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.489868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 97/194] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:58.496169 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.505700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299c09f-a62f-4d71-b202-abc46d60ebc1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.510632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3641b-aa61-4014-a2d4-97129b903e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.511496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3641b-aa61-4014-a2d4-97129b903e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.511776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3641b-aa61-4014-a2d4-97129b903e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.512050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3641b-aa61-4014-a2d4-97129b903e32 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc/users/c9ae58b4092f431d9920763647a309c7/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.514043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3641b-aa61-4014-a2d4-97129b903e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f287bc6964263ac5a9264981d29cc, user_id=c9ae58b4092f431d9920763647a309c7, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.516666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3641b-aa61-4014-a2d4-97129b903e32 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.583418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 98/195] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:58 2021] PUT /identity/v3/projects/698f287bc6964263ac5a9264981d29cc/users/c9ae58b4092f431d9920763647a309c7/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:07:58.697951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674d13-8474-4537-85d7-abae9e898a57 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.698274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674d13-8474-4537-85d7-abae9e898a57 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.698510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674d13-8474-4537-85d7-abae9e898a57 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.700457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 98/196] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:58.708257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.708587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.708870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.731830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:58.733060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:58.793926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:58.817220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674d13-8474-4537-85d7-abae9e898a57 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.829333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674d13-8474-4537-85d7-abae9e898a57 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.833736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.834512 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.834794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.835063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.845329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:58.851923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:07:58.859237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 99/198] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:07:58.860665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.870280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d14e8f-70fb-49a0-a053-22788ee7d3ca None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.874731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.875392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.875673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.875947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.876742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:58.877046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.878627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.887134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 100/199] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:58.893513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.904154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d3b1-71a2-4412-9ed9-069f78cb1023 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.908780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.909658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.909974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.910251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.911486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.913365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.920588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 100/200] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:58.921982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.932696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de46df7-4bf4-4755-ba11-71b93c543696 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.937199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3349b2-fc34-4951-9ad3-5d917d248457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.938101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3349b2-fc34-4951-9ad3-5d917d248457 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.938378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3349b2-fc34-4951-9ad3-5d917d248457 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.938652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3349b2-fc34-4951-9ad3-5d917d248457 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.939911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3349b2-fc34-4951-9ad3-5d917d248457 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.942105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3349b2-fc34-4951-9ad3-5d917d248457 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:58.943803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:58 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:58.950294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:58.960369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475870c5-12d0-453d-abb7-e3158a5359ac admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:58.964992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc34ab0-2e31-4b9d-a0e1-36ea38f1d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:58.965929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc34ab0-2e31-4b9d-a0e1-36ea38f1d716 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:58.966215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc34ab0-2e31-4b9d-a0e1-36ea38f1d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:58.966492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc34ab0-2e31-4b9d-a0e1-36ea38f1d716 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc/users/ff904f2428954da5908fbaf5fc605dce/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:58.968628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc34ab0-2e31-4b9d-a0e1-36ea38f1d716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f287bc6964263ac5a9264981d29cc, user_id=ff904f2428954da5908fbaf5fc605dce, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:58.971420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc34ab0-2e31-4b9d-a0e1-36ea38f1d716 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.043493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 101/202] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:58 2021] PUT /identity/v3/projects/698f287bc6964263ac5a9264981d29cc/users/ff904f2428954da5908fbaf5fc605dce/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:07:59.372071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c26e30-f529-4493-8630-c4303ad64780 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.372596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c26e30-f529-4493-8630-c4303ad64780 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.372703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c26e30-f529-4493-8630-c4303ad64780 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.374639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 102/203] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:59.382107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.382586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.382657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.385718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3959-feb7-42d3-91cc-ac811d21db00 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.386010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3959-feb7-42d3-91cc-ac811d21db00 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.386291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3959-feb7-42d3-91cc-ac811d21db00 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.388364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 103/204] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:07:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:07:59.401203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.401483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.401769 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.406266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:59.407671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:59.421038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:07:59.422215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:07:59.470280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 102/205] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:07:59.483719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 104/206] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:07:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:07:59.495508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.504481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972c20c-b020-4fac-9efa-d20b5efb37e7 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.507745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.510826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.511622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.511908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.512185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.513375 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:59.515079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.516809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 103/207] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:07:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:07:59.517114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2897f-a475-4081-979b-6b82e570759d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.523070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.525172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.526032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.526316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.526591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.533522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ac64-f498-4200-947a-f7cfba230f79 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.537592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:07:59.538238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03089e2d-471e-4cfe-9e58-1ebe8a527aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.538881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03089e2d-471e-4cfe-9e58-1ebe8a527aae admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.539223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03089e2d-471e-4cfe-9e58-1ebe8a527aae admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.539555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03089e2d-471e-4cfe-9e58-1ebe8a527aae admin admin] PATH_INFO: `/v3/groups` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.540271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03089e2d-471e-4cfe-9e58-1ebe8a527aae admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:59.542272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03089e2d-471e-4cfe-9e58-1ebe8a527aae admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.544884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:07:59.546279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 105/208] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:07:59 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:07:59.552494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.561842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1088823-8aa3-4371-8262-e3d576c3c8ef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.566090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.566761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.567041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.567317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.568051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:07:59.568355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:59.569949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.578911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 106/209] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:07:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:59.584771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.594822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993a536-e0e9-4a6b-a4bd-8990dd472803 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.599017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.599823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.600103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.600375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.601544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:59.603622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.605408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 107/210] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:07:59 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:59.610731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.619464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfe5fd-f6ee-415f-959f-a3a3f7ea88c0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.623604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.624351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.624665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.624938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.626061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:59.628557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.629700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 108/211] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:07:59 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:07:59.636214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:07:59.645711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0674-60b4-4db6-b24f-0b5d2d163cd9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:07:59.650921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3675c-0603-487b-a3ac-92759bc436bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:07:59.651705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3675c-0603-487b-a3ac-92759bc436bd admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:07:59.651995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3675c-0603-487b-a3ac-92759bc436bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:07:59.652287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3675c-0603-487b-a3ac-92759bc436bd admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc/users/c9ae58b4092f431d9920763647a309c7/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:07:59.654558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3675c-0603-487b-a3ac-92759bc436bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f287bc6964263ac5a9264981d29cc, user_id=c9ae58b4092f431d9920763647a309c7, role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:07:59.656679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 104/212] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 14 22:07:59 2021] POST /identity/v3/groups => generated 226 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:07:59.664496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3675c-0603-487b-a3ac-92759bc436bd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:07:59.756844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 109/213] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:07:59 2021] PUT /identity/v3/projects/698f287bc6964263ac5a9264981d29cc/users/c9ae58b4092f431d9920763647a309c7/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:08:00.873180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e9d1-6747-4a1b-8712-49a87b1855cd None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:00.873885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e9d1-6747-4a1b-8712-49a87b1855cd None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:00.873885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e9d1-6747-4a1b-8712-49a87b1855cd None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:00.875661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 105/214] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:00.883491 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:00.884623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:00.884623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:00.907967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:00.909191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:00.979792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 110/215] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:01.021913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e9d1-6747-4a1b-8712-49a87b1855cd None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.034494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e9d1-6747-4a1b-8712-49a87b1855cd None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.043654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.044452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.044742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.045019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.060355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:01.067537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:01.069214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 106/216] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:01.076356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.089971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b347c6-6a82-40c4-a4af-2947fdbabc9e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.094598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.095266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.095547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.095821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.096616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:01.096924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.098512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.110908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 111/217] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.118969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.130046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9981-9cef-4f49-b37f-f1beda2226a5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.140671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.141649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.141991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.142269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.143520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.145872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.147645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 107/218] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.153901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.163744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dccbba-15ea-433f-8cf5-cf1c551d1c7d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.172552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.173260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.173549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.173829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.189029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.190771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.200018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 112/219] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:01.206204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.216224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3c52-dde4-49b7-8876-7b272c11c537 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.226464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc2803-3f1d-4528-b71b-4be672bc498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.228065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2803-3f1d-4528-b71b-4be672bc498e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.228349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2803-3f1d-4528-b71b-4be672bc498e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.232724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2803-3f1d-4528-b71b-4be672bc498e admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.233970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc2803-3f1d-4528-b71b-4be672bc498e admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.236130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc2803-3f1d-4528-b71b-4be672bc498e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.237921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 108/220] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.245007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.258256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843eafd-e8d1-43d8-8c74-7b24fa681ffa admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.269117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.269792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.270075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.270354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.271203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] RBAC: Adding query filter params (role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=698f287bc6964263ac5a9264981d29cc, user.id=c9ae58b4092f431d9920763647a309c7) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:01.271511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.273437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b318e-9cbc-48c0-9ccc-fe5f28a8a2f9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.283557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 113/221] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/role_assignments?user.id=c9ae58b4092f431d9920763647a309c7&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.507945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5de2-1b68-4a0a-893e-4b49439098ae None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.508238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5de2-1b68-4a0a-893e-4b49439098ae None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.508445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5de2-1b68-4a0a-893e-4b49439098ae None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.510262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 109/222] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:01.518650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.518945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.519228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.549642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:01.550871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:01.558925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 114/223] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:01.598229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5de2-1b68-4a0a-893e-4b49439098ae None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.614112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5de2-1b68-4a0a-893e-4b49439098ae None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.621434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.622604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.622986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.623417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.639201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:01.647954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:01.650065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 110/224] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:01.656367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.670916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd6211-8982-4dd0-9363-d9f6ade99c1a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.677535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.678210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.678492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.678768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.679530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:01.679845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.681515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.692024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 115/225] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.698828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.708988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bc13c-e5a7-417c-bf49-e347eb856bf9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.718439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.719418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.719701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.720027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.721296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.723154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.724899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.731287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.745423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b2e3-9dca-4c11-a995-ee3ce5ebf885 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.756532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.757442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.757930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.758476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.776836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.778922 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.794027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 116/227] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:01.800542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.811121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7ce89-aec7-4423-9960-b5768a02df27 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.819415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09bee2-6ffe-4a16-a854-681c4d40b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.820539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09bee2-6ffe-4a16-a854-681c4d40b6db admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.821034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09bee2-6ffe-4a16-a854-681c4d40b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.822034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09bee2-6ffe-4a16-a854-681c4d40b6db admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.824340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09bee2-6ffe-4a16-a854-681c4d40b6db admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.826713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09bee2-6ffe-4a16-a854-681c4d40b6db admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.828806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:01.835270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:01.848905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc78caf-1b40-4d72-b233-7baf7b5fb537 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:01.858591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:01.859249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:01.859531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:01.859806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:01.860676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=698f287bc6964263ac5a9264981d29cc, user.id=ff904f2428954da5908fbaf5fc605dce) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:01.860986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:01.862823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4609aa-7dac-4426-a19e-f38997b56d2d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:01.870586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:01 2021] GET /identity/v3/role_assignments?user.id=ff904f2428954da5908fbaf5fc605dce&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:02.569830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c969ad-53a6-4916-93db-0fa6be213d26 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.570867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c969ad-53a6-4916-93db-0fa6be213d26 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.571402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c969ad-53a6-4916-93db-0fa6be213d26 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.573413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 113/230] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:02.581156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.581616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.581689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.605456 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:02.606645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:02.620168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 118/231] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:02.656632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c969ad-53a6-4916-93db-0fa6be213d26 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:02.674381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c969ad-53a6-4916-93db-0fa6be213d26 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:02.684951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:02.686078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.686563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.687035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.703229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:02.710941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:02.712441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 114/232] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:02.718862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:02.728859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17572-084b-481a-a571-e81fc5d5812c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:02.740678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:02.741356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.741637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.741912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.742670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:02.742975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:02.745174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:02.759435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 119/233] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:02.765991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:02.781406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828af79c-31bf-4b0e-a1b0-882ebf99e1c9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:02.792746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:02.793909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.794414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.794891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.801231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:02.803635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:02.805546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 115/234] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:08:02 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:02.812194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:02.826343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe5d4-5d84-4501-8abe-7816badca5d2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:02.835353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:02.836016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.836297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.836641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.852241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:02.854851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:02.863887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 120/235] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:02.870250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:02.886706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eff30-3a24-425d-a0ab-c55790e55a65 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:02.901145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3654bb-5e0c-4f36-b888-ee2ea39d677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:02.902408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3654bb-5e0c-4f36-b888-ee2ea39d677b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.902897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3654bb-5e0c-4f36-b888-ee2ea39d677b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.903472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3654bb-5e0c-4f36-b888-ee2ea39d677b admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.905035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3654bb-5e0c-4f36-b888-ee2ea39d677b admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:02.907343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3654bb-5e0c-4f36-b888-ee2ea39d677b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:02.909399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 116/236] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:02 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:02.916629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:02.925992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bfb76-ebe4-4377-96dc-234f36470d6e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:02.937551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:02.938220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:02.938504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:02.938780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:02.939616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] RBAC: Adding query filter params (role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=698f287bc6964263ac5a9264981d29cc, user.id=c9ae58b4092f431d9920763647a309c7) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:02.939925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:02.941818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482c265-2b36-49e1-9fac-9198728e128c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:02.952899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 121/237] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:02 2021] GET /identity/v3/role_assignments?user.id=c9ae58b4092f431d9920763647a309c7&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:03.091468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85b53-7c11-402a-99d2-c9c2fe67dee3 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.092118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85b53-7c11-402a-99d2-c9c2fe67dee3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.092683 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85b53-7c11-402a-99d2-c9c2fe67dee3 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.094682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 117/238] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:03.112827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.113128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.113379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.137594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:03.138807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:03.152474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 122/239] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:03.189541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85b53-7c11-402a-99d2-c9c2fe67dee3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.206483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85b53-7c11-402a-99d2-c9c2fe67dee3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.216232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b486b88-6d52-48db-b691-e0f7ea518371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.217363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b486b88-6d52-48db-b691-e0f7ea518371 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.217872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b486b88-6d52-48db-b691-e0f7ea518371 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.218344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b486b88-6d52-48db-b691-e0f7ea518371 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.249035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b486b88-6d52-48db-b691-e0f7ea518371 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:03.256412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0b486b88-6d52-48db-b691-e0f7ea518371 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:03.258095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 118/240] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:03.265478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.278958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833937f4-a5b9-499b-9783-75e642c8eb6a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.282396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24e45-1b6d-4f11-b0a5-c9224b9b51cb None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.283351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24e45-1b6d-4f11-b0a5-c9224b9b51cb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.285257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24e45-1b6d-4f11-b0a5-c9224b9b51cb None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.287844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 119/241] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:03.289714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.291215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.291703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.292286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.293327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:03.293845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.295681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527168-7cf6-49c9-91f6-a8bb97c2888b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.312358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 123/242] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:03.318212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24e45-1b6d-4f11-b0a5-c9224b9b51cb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.326788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.328334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.328808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.342622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24e45-1b6d-4f11-b0a5-c9224b9b51cb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.345340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.346274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.346763 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.348386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.370109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.371403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:03.372100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.375947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:03.387150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 124/243] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:03.392927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 120/244] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:03.395147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.409019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e10b28-94cf-4f11-929b-5d1eb5d01f05 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.416096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.417491 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.417994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.418477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.419898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.425465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.427462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 125/245] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:03.434328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.441446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.444313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd32b3-a244-4ea6-91b9-eebdcc3cc6a1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.454146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fee8a0-4e58-4524-b0e3-ef844f0758d8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.456074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.457194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.457702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.458195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.466229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.467285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.467786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.468260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.470368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.472839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:03.472839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:03.472839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:03.475153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.480069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 121/246] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:03.486978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.500516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:03.505563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:03.507107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 126/247] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:03.507769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1da4cb-6786-4bc2-8f1c-b611ce5e5eca admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.517874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.518240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.519007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.519528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.520006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.521088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=15970df938b34324ade5c0a6b2e46601) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:03.521603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.523643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.534451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 122/248] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:03.537423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad4ba-726f-41f5-bb67-288b5ed974fd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.548389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.549099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.549382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.549660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.550420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:03.550726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.552346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.678731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 127/249] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:03.687096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.697923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14777-c8ae-4599-9daa-a0b32f6a9586 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.708696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.709528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.962580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.962580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.962580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.962580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.962580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 123/250] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:03.963514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.963514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42d4e4-d628-4297-8b89-38543f06acc4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.963514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.963514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.964131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.964131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.964131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.964131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.964131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 128/251] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:03.964847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.964847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859774a-b82b-4eef-afba-2c02fc7d068f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.964847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523c45-0c5e-4364-b445-add0d33cb002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.964847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523c45-0c5e-4364-b445-add0d33cb002 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.965417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523c45-0c5e-4364-b445-add0d33cb002 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.965417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523c45-0c5e-4364-b445-add0d33cb002 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.965417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523c45-0c5e-4364-b445-add0d33cb002 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.965417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523c45-0c5e-4364-b445-add0d33cb002 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.965417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 124/252] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:03.966080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:03.966080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d67ca-f08c-472a-b4bd-7d3ee551e717 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:03.966080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:03.966080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:03.966652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:03.966652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:03.966652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=15970df938b34324ade5c0a6b2e46601) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:03.966652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:03.966652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f7fd1-223d-4028-876e-39246a5a7840 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:03.967335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 129/253] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:03 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:04.468487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3889b1-4eda-4d15-9746-c95cea43f1eb None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.468881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3889b1-4eda-4d15-9746-c95cea43f1eb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.469064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3889b1-4eda-4d15-9746-c95cea43f1eb None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.470815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 125/254] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:04.482973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.483575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.484074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.508329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:04.510062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:04.520226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 130/255] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:04.561914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3889b1-4eda-4d15-9746-c95cea43f1eb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.576926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3889b1-4eda-4d15-9746-c95cea43f1eb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.588615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.589817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.590308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.590776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.603833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:04.617817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:04.619480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 126/256] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:04.625926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.635244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea74e2-0763-4989-b9a5-6751ab10e670 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.644001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.644921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.645411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.645884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.646843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:04.647352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.649182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.662765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 131/257] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:04.669066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.679703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111748-8f61-49e6-af02-196f71e2b2b2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.688409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400992-6d74-45b8-978e-87dedb8cd355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.689744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400992-6d74-45b8-978e-87dedb8cd355 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.690237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400992-6d74-45b8-978e-87dedb8cd355 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.690727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400992-6d74-45b8-978e-87dedb8cd355 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.699745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400992-6d74-45b8-978e-87dedb8cd355 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.701744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400992-6d74-45b8-978e-87dedb8cd355 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.714279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 127/258] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:04.720826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.733576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931a8f-facd-46db-8219-7f1cb631b109 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.738295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.739399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.739899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.740370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.745151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.748195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0d97a-418a-4c2d-b7ad-dd1704cad4d8 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.748739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0d97a-418a-4c2d-b7ad-dd1704cad4d8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.749213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0d97a-418a-4c2d-b7ad-dd1704cad4d8 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.751164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 128/259] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:04.752289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.754518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 132/260] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:04.758322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.759208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.759447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.763524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.785707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57062-eef0-4278-be38-e2065ede1035 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.787196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:04.788398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:04.794535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.795393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.795682 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.795960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.797625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.798626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:04.798626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:04.798626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:04.799824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.801614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 133/261] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:04.806418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 129/262] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:04.811232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.821615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16b933-fcf2-4f66-9a2f-00ff27d5eab8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.832609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.833267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.833555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.833838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.834677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=698f287bc6964263ac5a9264981d29cc) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:04.834995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.837425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.843671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 134/263] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:04.858625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.869425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee0af7-1c32-4e1e-8f36-1a9d90b69ee0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.874022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.874837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.875123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.875403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.887813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:04.895471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:04.897009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 130/264] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:04.903877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.914755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5708c-a51c-4f2a-8b66-292d69694d74 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.920856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.921592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.921881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.922203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.922966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:04.923278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.924995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.935689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 135/265] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:04.941941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:04.953150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05679fe-b5e7-4e9b-b3be-a87a96c03a26 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:04.957989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:04.958723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:04.959015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:04.959298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:04.968979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:04.970858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:04.985037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:04.991442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.002600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77717d-edd2-491c-bbdc-8729b4eba2d8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.013341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.014593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.015075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.015540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.017213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.019607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.021835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 136/267] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:04 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:05.029573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.042314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb48997-93e2-4fa4-8597-3e6f969e0977 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.050082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f68506-0e5c-423f-9cdf-b69b648f02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.051054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f68506-0e5c-423f-9cdf-b69b648f02a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.051393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f68506-0e5c-423f-9cdf-b69b648f02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.051685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f68506-0e5c-423f-9cdf-b69b648f02a4 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.053410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f68506-0e5c-423f-9cdf-b69b648f02a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.055475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f68506-0e5c-423f-9cdf-b69b648f02a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.058026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 132/268] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:05.064518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.077851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee2758-c33c-4365-b1db-5214aff6808d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.085362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.086389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.087412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.087892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.088991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=698f287bc6964263ac5a9264981d29cc) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:05.089514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.091658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248827c1-70a5-4854-906c-6ffd31dbd4a6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.099957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 137/269] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:05.632559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6362267-5dbf-404b-8d35-7d006a405016 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.633269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6362267-5dbf-404b-8d35-7d006a405016 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.634306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6362267-5dbf-404b-8d35-7d006a405016 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.636360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 133/270] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:05.643979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.644267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.644583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.669455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:05.670658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:05.680986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 138/271] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:05.717229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6362267-5dbf-404b-8d35-7d006a405016 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.741111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6362267-5dbf-404b-8d35-7d006a405016 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.746276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.747330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.747822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.748315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.764744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:05.771954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:05.773421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 134/272] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:05.780445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.796835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654ca3-b1e0-4d10-ae1b-29c20f319b71 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.805032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.806254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.806536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.806814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.807574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:05.807880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.809523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.818471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 139/273] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:05.825047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.836482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd7cf-6a16-47d6-9cb5-271a64efdd40 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.844699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.845806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.846296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.846774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.857668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.859736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.873084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 135/274] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:05.878935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.894985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f78513-a750-408d-909a-f158de62ba50 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.904501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.905367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.905653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.905937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] PATH_INFO: `/v3/projects/28134749d4e040b88a7f85c383c201c7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.913211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=28134749d4e040b88a7f85c383c201c7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.915113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.916865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 140/275] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/projects/28134749d4e040b88a7f85c383c201c7 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:05.922880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.936440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3ad04-7c1b-4611-8b0e-6b5395ef1d32 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.950424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a49c9-5e52-4a4a-a1d6-d2666b716100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.951293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a49c9-5e52-4a4a-a1d6-d2666b716100 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.951580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a49c9-5e52-4a4a-a1d6-d2666b716100 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.951861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a49c9-5e52-4a4a-a1d6-d2666b716100 admin admin] PATH_INFO: `/v3/groups/a914ca85f013461ca1a0d7b796c5b5d6` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.961293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a49c9-5e52-4a4a-a1d6-d2666b716100 admin admin] RBAC: Authorizing `identity:get_group(group_id=a914ca85f013461ca1a0d7b796c5b5d6)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:05.963226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a49c9-5e52-4a4a-a1d6-d2666b716100 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:05.965193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 136/276] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/groups/a914ca85f013461ca1a0d7b796c5b5d6 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:05.971161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:05.981388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b081-caa2-4131-bf81-992bb46b9fc8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:05.997141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:05.997807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:05.998094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:05.998376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:05.999221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] RBAC: Adding query filter params (group.id=a914ca85f013461ca1a0d7b796c5b5d6, role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=28134749d4e040b88a7f85c383c201c7) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:05.999539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:06.001600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd525-3002-4577-9b9f-1e94437557da admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:06.007946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 141/277] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:05 2021] GET /identity/v3/role_assignments?group.id=a914ca85f013461ca1a0d7b796c5b5d6&scope.project.id=28134749d4e040b88a7f85c383c201c7&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:06.117787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d761af-ca19-4071-8706-e45bc3d56757 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.118163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d761af-ca19-4071-8706-e45bc3d56757 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.118411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d761af-ca19-4071-8706-e45bc3d56757 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.120228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 137/278] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:06.129415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.130088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.130567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.161582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:06.163168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:06.177893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 142/279] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:06.208660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d761af-ca19-4071-8706-e45bc3d56757 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:06.224966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d761af-ca19-4071-8706-e45bc3d56757 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:06.230986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:06.231788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.232076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.232358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.257374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:06.264877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:06.266411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 138/280] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:06.272742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:06.286195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b47647-3878-41f1-8990-5e94ea7642e7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:06.301056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:06.301747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.302034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.302312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.303068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:06.303374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:06.304998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:06.319988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 143/281] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:06.326469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:06.342230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635b41-eaa3-48cf-a069-f205fc36790a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:06.354040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:06.355168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.355457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.355740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.361170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:06.363086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:06.364974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 139/282] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:06 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:06.371020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:06.386040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635abd8c-eee3-4a74-a4e7-4f048dc54753 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:06.395412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af330285-ddcf-4baf-8153-7b84dc43e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:06.396283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330285-ddcf-4baf-8153-7b84dc43e953 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.396598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330285-ddcf-4baf-8153-7b84dc43e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.396874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330285-ddcf-4baf-8153-7b84dc43e953 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.401170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af330285-ddcf-4baf-8153-7b84dc43e953 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:06.403230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af330285-ddcf-4baf-8153-7b84dc43e953 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:06.404961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 144/283] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:06 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:06.411394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:06.426834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848a224-c59d-4de5-a0fb-3cd2e964b9f4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:06.436114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65eca-21fd-4877-a255-397b42347d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:06.437029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65eca-21fd-4877-a255-397b42347d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.437309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65eca-21fd-4877-a255-397b42347d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.437591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65eca-21fd-4877-a255-397b42347d41 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601/groups/733decf8f53c4158b80f2527aef41743/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.445758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb65eca-21fd-4877-a255-397b42347d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970df938b34324ade5c0a6b2e46601, group_id=733decf8f53c4158b80f2527aef41743, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:06.449019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb65eca-21fd-4877-a255-397b42347d41 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:06.565942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 140/284] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 14 22:08:06 2021] PUT /identity/v3/projects/15970df938b34324ade5c0a6b2e46601/groups/733decf8f53c4158b80f2527aef41743/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:06.895107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15738e8c-2943-4af0-8ae4-31be4414025e None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.895635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15738e8c-2943-4af0-8ae4-31be4414025e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.895635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15738e8c-2943-4af0-8ae4-31be4414025e None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.897680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 145/285] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:06.905170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:06.905639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:06.905715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:06.925313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:06.926483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:06.984362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 141/286] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:07.009154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15738e8c-2943-4af0-8ae4-31be4414025e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.021520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15738e8c-2943-4af0-8ae4-31be4414025e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:07.025944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:07.026735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.027011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.027281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.037850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:07.045411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:07.046599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 146/287] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:07.053218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.062812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6b2a3-a531-4bc4-9eb1-70a888a388fc None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:07.069977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:07.070694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.071018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.071297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.072052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:07.072358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:07.073977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:07.082992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 142/288] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:07.089461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.101845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037b59-f127-4c39-a244-63dcdfd04fa5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:07.107443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:07.108536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.109006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.109480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.110833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:07.112954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:07.114895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 147/289] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:07 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:07.121621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.137455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72744-f6b0-469a-aaac-8577401c1466 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:07.144339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ba460-1e1f-4665-8655-812116ac1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:07.145442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ba460-1e1f-4665-8655-812116ac1b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.145732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ba460-1e1f-4665-8655-812116ac1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.146081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ba460-1e1f-4665-8655-812116ac1b31 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.147332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ba460-1e1f-4665-8655-812116ac1b31 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:07.149539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ba460-1e1f-4665-8655-812116ac1b31 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:07.151295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 143/290] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:07 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:07.158171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.170350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ac12-7596-4fa4-9ae4-396e2e892283 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:07.177604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cfbae-d8dc-4a95-9265-214f8aa397e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:07.178765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cfbae-d8dc-4a95-9265-214f8aa397e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.179234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cfbae-d8dc-4a95-9265-214f8aa397e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.179758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cfbae-d8dc-4a95-9265-214f8aa397e5 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601/groups/733decf8f53c4158b80f2527aef41743/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.182871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cfbae-d8dc-4a95-9265-214f8aa397e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15970df938b34324ade5c0a6b2e46601, group_id=733decf8f53c4158b80f2527aef41743, role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:07.185867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cfbae-d8dc-4a95-9265-214f8aa397e5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:07.303042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 148/291] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 14 22:08:07 2021] PUT /identity/v3/projects/15970df938b34324ade5c0a6b2e46601/groups/733decf8f53c4158b80f2527aef41743/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:07.786505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3c009-7a03-459b-ab2b-b9bf34f0533a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.786868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3c009-7a03-459b-ab2b-b9bf34f0533a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.787068 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3c009-7a03-459b-ab2b-b9bf34f0533a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.789252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 144/292] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:07.796488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.797076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.797562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.820464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:07.822499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:07.893303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 149/293] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:07.934963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3c009-7a03-459b-ab2b-b9bf34f0533a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.953587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3c009-7a03-459b-ab2b-b9bf34f0533a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:07.958150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321018b-33a5-4231-b78f-3994c9994000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:07.958941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321018b-33a5-4231-b78f-3994c9994000 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.959220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321018b-33a5-4231-b78f-3994c9994000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.959496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321018b-33a5-4231-b78f-3994c9994000 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.977404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321018b-33a5-4231-b78f-3994c9994000 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:07.984550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-9321018b-33a5-4231-b78f-3994c9994000 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:07.985770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 145/294] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:07.993134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:07.993625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213b56-4f00-459f-8432-401c6ab4e863 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:07.993829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213b56-4f00-459f-8432-401c6ab4e863 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:07.994075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213b56-4f00-459f-8432-401c6ab4e863 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:07.995814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 146/295] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:08.002599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d3bf-36f8-4d93-ba9e-c7f62e754595 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.014378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.014671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.014953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.017645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.018323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.018612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.018895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.019656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:08.019963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.021576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.032122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 150/296] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:08.036265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:08.037171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:08.038184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.052234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 147/297] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:08.058415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54904a-572f-4da0-a520-9cc85437501d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.064670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.065604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.065889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.066157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.067437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.069502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.071993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 151/298] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:08 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:08.077247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.084667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.087800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b6a70-0d7a-430c-89f0-b08613c15b70 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.096085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.096957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.098004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.098287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.106546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51abdb-1a53-46fd-856e-5fa41cde8555 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.115558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.118423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.118716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.119044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.121317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.122071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:08.124302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.131565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 152/299] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:08 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:08.134444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:08.136459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.142409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 148/300] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:08.149298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.159552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3175-d304-4fcb-b48e-078175d645bc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.163448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b925c85-f3fe-4d0d-92ad-ffed7386258e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.168521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb173e8-24f1-46a1-a3dd-de9915fff611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.170173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb173e8-24f1-46a1-a3dd-de9915fff611 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.170807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb173e8-24f1-46a1-a3dd-de9915fff611 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.171088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb173e8-24f1-46a1-a3dd-de9915fff611 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc/groups/733decf8f53c4158b80f2527aef41743/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.172504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.173660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.174479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.175296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb173e8-24f1-46a1-a3dd-de9915fff611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f287bc6964263ac5a9264981d29cc, group_id=733decf8f53c4158b80f2527aef41743, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.176161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.176944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:08.177250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.180244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.181628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb173e8-24f1-46a1-a3dd-de9915fff611 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.198847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 149/301] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:08.204697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.214891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eb874-4ae6-48c2-9b14-9673842c1c73 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.219785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.220929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.221462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.221929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.223313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.225399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.227323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 150/302] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:08 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:08.233753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.253855 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393cff0-c3e1-47fd-975c-6e7dd0a252bd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.261200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.262292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.267318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.267318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.267318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.267318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.269027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 151/303] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:08 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:08.274756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:08.285850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddcac8-1d5c-4ce8-b468-52e8ab211e57 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:08.290912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf57b3-4137-4eb2-b861-c8c02e412106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:08.291852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf57b3-4137-4eb2-b861-c8c02e412106 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.292142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf57b3-4137-4eb2-b861-c8c02e412106 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.292524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf57b3-4137-4eb2-b861-c8c02e412106 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc/groups/733decf8f53c4158b80f2527aef41743/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.294824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf57b3-4137-4eb2-b861-c8c02e412106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f287bc6964263ac5a9264981d29cc, group_id=733decf8f53c4158b80f2527aef41743, role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:08.297749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf57b3-4137-4eb2-b861-c8c02e412106 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:08.305888 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 153/304] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 14 22:08:08 2021] PUT /identity/v3/projects/698f287bc6964263ac5a9264981d29cc/groups/733decf8f53c4158b80f2527aef41743/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:08.387032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 152/305] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 14 22:08:08 2021] PUT /identity/v3/projects/698f287bc6964263ac5a9264981d29cc/groups/733decf8f53c4158b80f2527aef41743/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:08.852859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968642-5167-4101-aa57-cfb0c8a7c10d None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.853151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968642-5167-4101-aa57-cfb0c8a7c10d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.853432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0968642-5167-4101-aa57-cfb0c8a7c10d None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.855748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 154/306] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:08.863173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22948be-df16-46a8-b369-7591fb881947 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:08.863459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22948be-df16-46a8-b369-7591fb881947 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:08.863739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22948be-df16-46a8-b369-7591fb881947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:08.884089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b22948be-df16-46a8-b369-7591fb881947 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:08.885301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b22948be-df16-46a8-b369-7591fb881947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:08.955029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 153/307] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:09.003325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0968642-5167-4101-aa57-cfb0c8a7c10d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.016232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0968642-5167-4101-aa57-cfb0c8a7c10d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.024546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.025338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.025619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.025890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.043447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:09.050135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:09.051328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 155/308] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:09.058480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22948be-df16-46a8-b369-7591fb881947 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.067569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22948be-df16-46a8-b369-7591fb881947 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.076399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.077101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.077383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.077657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.078411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:09.078716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:09.080287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:09.092037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 154/309] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:09.098060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.113388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafaad-99ff-4661-9c2d-2fa8f8400164 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.120992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.121838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.122119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.122395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] PATH_INFO: `/v3/groups/a914ca85f013461ca1a0d7b796c5b5d6` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.123580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] RBAC: Authorizing `identity:get_group(group_id=a914ca85f013461ca1a0d7b796c5b5d6)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:09.125486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:09.127062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 156/310] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/groups/a914ca85f013461ca1a0d7b796c5b5d6 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:09.133260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.145386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9896dbe-9370-4a22-addc-08e788efa10f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.151340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc69e1c-0414-4fa3-86a8-786ecd0527bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.152192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69e1c-0414-4fa3-86a8-786ecd0527bd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.152506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69e1c-0414-4fa3-86a8-786ecd0527bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.152783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69e1c-0414-4fa3-86a8-786ecd0527bd admin admin] PATH_INFO: `/v3/projects/28134749d4e040b88a7f85c383c201c7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.153959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc69e1c-0414-4fa3-86a8-786ecd0527bd admin admin] RBAC: Authorizing `identity:get_project(project_id=28134749d4e040b88a7f85c383c201c7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:09.155734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc69e1c-0414-4fa3-86a8-786ecd0527bd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:09.157579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 155/311] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/projects/28134749d4e040b88a7f85c383c201c7 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:09.163647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.177343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf308-bb7c-42c1-b8e7-8e99ae5a75e2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.184549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010057ec-97c6-4fe2-830c-f408967a33f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.185421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010057ec-97c6-4fe2-830c-f408967a33f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.185705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010057ec-97c6-4fe2-830c-f408967a33f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.185980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010057ec-97c6-4fe2-830c-f408967a33f7 admin admin] PATH_INFO: `/v3/projects/28134749d4e040b88a7f85c383c201c7/groups/a914ca85f013461ca1a0d7b796c5b5d6/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.187943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010057ec-97c6-4fe2-830c-f408967a33f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28134749d4e040b88a7f85c383c201c7, group_id=a914ca85f013461ca1a0d7b796c5b5d6, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:09.190584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010057ec-97c6-4fe2-830c-f408967a33f7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:09.287986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 157/312] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 14 22:08:09 2021] PUT /identity/v3/projects/28134749d4e040b88a7f85c383c201c7/groups/a914ca85f013461ca1a0d7b796c5b5d6/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:09.693285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddc76-737e-4834-92a6-0ec28c2b2347 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.693285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddc76-737e-4834-92a6-0ec28c2b2347 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.693285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddc76-737e-4834-92a6-0ec28c2b2347 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.694222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 156/313] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:09.705275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.705275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.705275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.726903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:09.728539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:09.810991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 158/314] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:09.857107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddc76-737e-4834-92a6-0ec28c2b2347 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.874301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddc76-737e-4834-92a6-0ec28c2b2347 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.884778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.885574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.885858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.886132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.902722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:09.909509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:09.911091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 157/315] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:09.917668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.932547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d439c-7b0a-4ed2-9136-ddb0472a9485 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.940269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.941181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.941633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.942056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:09.942957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:09.943484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:09.945339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:09.958612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 159/316] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:09.964685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:09.977848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bae5f-6c6c-42f3-a290-c1927417c60b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:09.988213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:09.988889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:09.989174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:09.989449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.004873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.006716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.022934 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 158/317] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:10.028986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.043708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18326a-d3dd-4d25-983a-3a61bb0166ea admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.052772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.054058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.054565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.055041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.061213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.063620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.065671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 160/318] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:10.071840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.085470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2bf80-0949-4a8d-8db1-bf07d449b893 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.092408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec0afe-81e3-4c51-a102-0927c356cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.093307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0afe-81e3-4c51-a102-0927c356cada admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.093590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0afe-81e3-4c51-a102-0927c356cada admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.093866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0afe-81e3-4c51-a102-0927c356cada admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.095058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec0afe-81e3-4c51-a102-0927c356cada admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.097026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec0afe-81e3-4c51-a102-0927c356cada admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.099083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 159/319] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:10.106494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.122181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2868b7-145a-47db-b66f-79cf97c28998 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.129550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.130439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.130962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.131461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.132582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=15970df938b34324ade5c0a6b2e46601) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:10.133100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.136183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821674e2-41c6-433f-8dc5-be3e4509f0c1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.149748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 161/320] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 611 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:10.169829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec720d1-2f71-4efb-ba4a-ae40233eda81 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.170159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec720d1-2f71-4efb-ba4a-ae40233eda81 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.170394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec720d1-2f71-4efb-ba4a-ae40233eda81 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.172452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 160/321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:10.186553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.187188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.187699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.214706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:10.215818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:10.227740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 162/322] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:10.271045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec720d1-2f71-4efb-ba4a-ae40233eda81 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.286200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec720d1-2f71-4efb-ba4a-ae40233eda81 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.293971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.294785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.295067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.295342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.306875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:10.314126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:10.315691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 161/323] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:10.321956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.331126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2802a-1d15-4990-b493-e423ee89554a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.340823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.341507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.341786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.342062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.342817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:10.343121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.344731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.356585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 163/324] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:10.363119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.377716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e26f-acb9-459c-a467-d5693654af93 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.386009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.386737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.387028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.387307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.400376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.402151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.414172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 162/325] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:10.421416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.433368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50ad3-8001-49f4-878f-b809ee684701 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.438474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.439327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.439607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.439879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.441916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.443977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.446066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 164/326] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:10.452025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.461001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0824cf-5602-41bf-b16e-ea9554888e00 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.467980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f3f3-21d9-4818-a38b-d7eecfd49392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.468822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f3f3-21d9-4818-a38b-d7eecfd49392 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.469102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f3f3-21d9-4818-a38b-d7eecfd49392 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.469376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f3f3-21d9-4818-a38b-d7eecfd49392 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.470527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4f3f3-21d9-4818-a38b-d7eecfd49392 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.472398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4f3f3-21d9-4818-a38b-d7eecfd49392 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.474004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 163/327] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:10.481449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:10.492116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493fce0-5f0f-4686-b329-95395d09419c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:10.499613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:10.500270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:10.500593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:10.500870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:10.501698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=15970df938b34324ade5c0a6b2e46601) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:10.502008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:10.503843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4c091-4745-41c8-9551-8c0137503a58 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:10.513316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 165/328] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:10 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=15970df938b34324ade5c0a6b2e46601&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:11.146107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b2cba-98d7-4187-8a0b-7805dbfd0226 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.146629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b2cba-98d7-4187-8a0b-7805dbfd0226 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.146723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b2cba-98d7-4187-8a0b-7805dbfd0226 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.148710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 164/329] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:11.156335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.156793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.156963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.160640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371cb1-e2c8-4783-b850-026ec1809b89 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.160933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371cb1-e2c8-4783-b850-026ec1809b89 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.161220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371cb1-e2c8-4783-b850-026ec1809b89 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.163042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 165/330] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:11.170710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.171000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.171287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.176485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:11.177685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:11.185507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 166/331] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:11.188202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:11.189372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:11.196699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 166/332] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:11.209226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.218503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443d869-d2e2-4126-9f20-1230701b0186 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.220490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.223073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.223863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.224146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.224577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.230132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aef88-2a81-4273-85c6-b355f487a41f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.235616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:11.237432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.238442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.238918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.239364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.243502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:11.244804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 167/333] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:11.250760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:11.251012 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.257647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 22:08:11.258818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 167/334] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:11.261074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43b765-2e73-49a2-8c7a-c9aa69b0617a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.265070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.265482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59999307-07e4-487c-b265-47faca49483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.266136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999307-07e4-487c-b265-47faca49483e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.266419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999307-07e4-487c-b265-47faca49483e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.266693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59999307-07e4-487c-b265-47faca49483e admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.267441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59999307-07e4-487c-b265-47faca49483e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:11.267747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59999307-07e4-487c-b265-47faca49483e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.269353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59999307-07e4-487c-b265-47faca49483e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.275414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8e4c-399c-4521-ba62-07bff107eba1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.278827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 168/335] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:11.284673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.284801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59999307-07e4-487c-b265-47faca49483e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.285376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.285664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.285943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.286717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:11.287027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.288799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.294524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59999307-07e4-487c-b265-47faca49483e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.303287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 168/336] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:11.303415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.303415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.303415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.303415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.304287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.308552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.310296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.313486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e5bad-9b21-4e3d-bf1b-9976137b6924 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.319220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 169/337] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:08:11.319729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.320366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.320686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.326333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.326426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.328967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.330702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.333580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ef8d5-a9f9-4b73-8426-dd0b5432c736 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.338623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.339434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.339719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.339899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 169/338] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:08:11.340298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.341516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.343597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.350293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 170/339] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:11.350410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.351061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.356147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fe83-5c95-4b7d-a54c-39027206a74a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.360537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.360987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bce643-e068-49a7-a007-3920cfff8c19 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.361382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.361680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.362019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.363129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.365178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.365558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.366528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.366969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 170/340] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:11.367133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.367275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.368490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.370302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.372450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:11.377237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.378150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.387836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf484fc-1e29-4572-a998-425c76b58514 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.388082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5875-dbb5-4b85-b964-7e8454fcfd98 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.392120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.392687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.392798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.393047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.393325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.393842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.394132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=698f287bc6964263ac5a9264981d29cc) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:11.394300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.394442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.394755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] PATH_INFO: `/v3/groups/733decf8f53c4158b80f2527aef41743` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.395999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] RBAC: Authorizing `identity:get_group(group_id=733decf8f53c4158b80f2527aef41743)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.396278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf175fc6-301d-4534-8be5-b61c59f33508 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.398163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.400531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/groups/733decf8f53c4158b80f2527aef41743 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:11.412862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 172/343] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:11.413062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.423544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496148-3a85-48de-a202-8eccbee7ec4a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.428299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.429120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.429480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.429827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.430798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] RBAC: Adding query filter params (group.id=733decf8f53c4158b80f2527aef41743, role.id=97fea09c5d2643c08c6c753c1392de1b, scope.project.id=698f287bc6964263ac5a9264981d29cc) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:11.431181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:11.433173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f420d-cb23-488d-b208-92e89167c8c8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:11.440745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 172/344] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/role_assignments?group.id=733decf8f53c4158b80f2527aef41743&scope.project.id=698f287bc6964263ac5a9264981d29cc&role.id=97fea09c5d2643c08c6c753c1392de1b => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:11.881504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c42f-6c86-4026-a15e-a2103052c211 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.881797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c42f-6c86-4026-a15e-a2103052c211 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.882053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c42f-6c86-4026-a15e-a2103052c211 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.884383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 173/345] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:11.891938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.892301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.892620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.910257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:11.911439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:11.918953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 173/346] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:11.943847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257c42f-6c86-4026-a15e-a2103052c211 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.956257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257c42f-6c86-4026-a15e-a2103052c211 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.960425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.961214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.961522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:11.961796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:11.971526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:11.978198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:11.979596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 174/347] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:11.985677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:11.994816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90028-5d9d-47cd-97df-8f3aa6474d98 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:11.999018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:11.999660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:11.999945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:12.000222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:12.000995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:12.001304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:12.002862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:12.011347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 174/348] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:12.016977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:12.026678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37f669-690e-4cab-8e48-d73a72936d3c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:12.030916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:12.031525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:12.031806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:12.032077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:12.039472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:12.041231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:12.049664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 175/349] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:08:12.055571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:12.064499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1a579-0770-4e0a-a2e9-46943d306371 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:12.068682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:12.069493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:12.069797 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:12.070111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] PATH_INFO: `/v3/projects/28134749d4e040b88a7f85c383c201c7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:12.071865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] RBAC: Authorizing `identity:get_project(project_id=28134749d4e040b88a7f85c383c201c7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:12.073633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:12.075194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:08:12 2021] GET /identity/v3/projects/28134749d4e040b88a7f85c383c201c7 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:12.080565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:12.089224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b560-dee0-4169-a6d1-4f62f42191ef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:12.093450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d002a8-dcec-4e4d-b84f-866ae38ce942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:12.094238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d002a8-dcec-4e4d-b84f-866ae38ce942 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:12.094519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d002a8-dcec-4e4d-b84f-866ae38ce942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:12.094790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d002a8-dcec-4e4d-b84f-866ae38ce942 admin admin] PATH_INFO: `/v3/groups/a914ca85f013461ca1a0d7b796c5b5d6` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:12.095902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d002a8-dcec-4e4d-b84f-866ae38ce942 admin admin] RBAC: Authorizing `identity:get_group(group_id=a914ca85f013461ca1a0d7b796c5b5d6)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:12.097729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d002a8-dcec-4e4d-b84f-866ae38ce942 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:12.099225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 176/351] 10.222.0.20 () {56 vars in 1202 bytes} [Tue Sep 14 22:08:12 2021] GET /identity/v3/groups/a914ca85f013461ca1a0d7b796c5b5d6 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:12.105086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:12.113962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e683-19ff-4f88-a59e-a2ac614a9583 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:12.118670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:12.119345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:12.119643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:12.119917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:12.120744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] RBAC: Adding query filter params (group.id=a914ca85f013461ca1a0d7b796c5b5d6, role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=28134749d4e040b88a7f85c383c201c7) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:12.121050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:12.122791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b23bb5-994f-443e-85d3-8567fb22c29e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:12.128210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 176/352] 10.222.0.20 () {56 vars in 1398 bytes} [Tue Sep 14 22:08:12 2021] GET /identity/v3/role_assignments?group.id=a914ca85f013461ca1a0d7b796c5b5d6&scope.project.id=28134749d4e040b88a7f85c383c201c7&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:14.770493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc16d-f24b-49fc-a21c-00c9e3faeda9 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:14.771040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc16d-f24b-49fc-a21c-00c9e3faeda9 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:14.771040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc16d-f24b-49fc-a21c-00c9e3faeda9 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:14.772893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 177/353] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:14.782660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:14.783150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:14.783234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:14.813441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:14.814647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:14.822698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 177/354] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:14.874090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc16d-f24b-49fc-a21c-00c9e3faeda9 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:14.890237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc16d-f24b-49fc-a21c-00c9e3faeda9 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:14.898020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:14.898860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:14.899143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:14.899415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:14.912400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:14.914254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:14.935976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:14.937613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 178/355] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:14.944205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:14.959023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f432a-8dec-48f1-b09f-f69d3485b29f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:14.968961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:14.969648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:14.969931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:14.970211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:14.970951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:14.971258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:14.972265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:14.972265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:14.972265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:14.975253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be924d63-b5de-4e3d-8b10-4ab776cf2df5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.003747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 178/356] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:15.010377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.023928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a704-26ad-403e-b883-ab1024049464 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.030383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1112-2d48-4d5d-b93c-ed5e5df0a116 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.030680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1112-2d48-4d5d-b93c-ed5e5df0a116 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.030945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1112-2d48-4d5d-b93c-ed5e5df0a116 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.031630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.032298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.032617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.032782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 179/357] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:15.032949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.033582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.035486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.046977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8605d-f473-47b4-b1dd-6dad2c58432a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.047277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8605d-f473-47b4-b1dd-6dad2c58432a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.047563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8605d-f473-47b4-b1dd-6dad2c58432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.071768 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-29f8605d-f473-47b4-b1dd-6dad2c58432a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:15.073005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-29f8605d-f473-47b4-b1dd-6dad2c58432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:15.082649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 180/358] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:15.084020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec5c29-65d7-48e9-98d6-b4d0703a3598 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.084309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec5c29-65d7-48e9-98d6-b4d0703a3598 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.084682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec5c29-65d7-48e9-98d6-b4d0703a3598 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.086790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 181/359] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:15.099994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.100274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.100577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.121467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:15.122634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:15.130388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 182/360] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:15.131027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.142409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45634e9d-6240-460b-b2bb-fa05756a180b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.147676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.152597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.152597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.152801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 179/361] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:08:15 2021] POST /identity/v3/users => generated 246 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:15.152884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.162101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.164967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.184005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:15.186000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 183/362] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:15.192274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.196067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.204625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77904ca3-be3b-46c6-8fca-f4d50ca89fb2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.206716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e54b41-a8e2-4cb4-8d8a-5f49a262e383 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.209581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.210422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.210806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.211251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.212145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:15.212574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.213138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.214100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.214481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.214671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.215093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.226169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.228591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 180/363] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:15.229786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.234905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.245702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc8f7e-4b80-4a3b-8e12-51998ddd0a15 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.250558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da8e5-a1c3-42ea-b308-eba302372948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.250906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:15.251470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da8e5-a1c3-42ea-b308-eba302372948 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.251904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da8e5-a1c3-42ea-b308-eba302372948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.252296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da8e5-a1c3-42ea-b308-eba302372948 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.252538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 184/364] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:15.257571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8da8e5-a1c3-42ea-b308-eba302372948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.259752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8da8e5-a1c3-42ea-b308-eba302372948 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.263448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.284126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48761a-4532-4307-991d-556d6476f6bf admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.296257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.297462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.297986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.298576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.299604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:15.300126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.302128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.317466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 185/365] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:15.324886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.336235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585476-7d3b-4c74-93b6-040b55a323d4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.343412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.344816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:15.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e6fc4-62c5-419a-a8e0-9b65f8cee91e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:15.469154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 181/366] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:08:15 2021] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:08:15.612730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 186/367] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:08:15 2021] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:08:15.860698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc6f2-a5b9-4d98-b4f6-d14e5e5ab9da None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.861690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc6f2-a5b9-4d98-b4f6-d14e5e5ab9da None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.862224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc6f2-a5b9-4d98-b4f6-d14e5e5ab9da None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.864601 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 182/368] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:15.872055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.872568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.872653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.893744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:15.894940 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:15.905178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 187/369] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:15.932033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc6f2-a5b9-4d98-b4f6-d14e5e5ab9da None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:15.947399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc6f2-a5b9-4d98-b4f6-d14e5e5ab9da None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:15.956161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:15.957042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:15.957336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:15.957605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:15.973498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:15.975339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:16.000819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:16.002030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 183/370] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:16.008869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:16.021385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ba2a3-f8a0-4f0b-927e-13ab16f08094 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:16.029039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:16.029719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.030007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.030288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.031018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:16.031328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:16.032957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d7c3a-d971-433c-90a4-516e934817a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:16.050936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 188/371] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:16.057073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:16.069392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0efe1c-0ec9-4021-9c39-b479853e00b6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:16.078396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b8e47-31ea-49ad-a1b6-dcd8689556d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:16.079066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b8e47-31ea-49ad-a1b6-dcd8689556d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.079348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b8e47-31ea-49ad-a1b6-dcd8689556d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.079627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b8e47-31ea-49ad-a1b6-dcd8689556d6 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.080343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b8e47-31ea-49ad-a1b6-dcd8689556d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:16.082278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b8e47-31ea-49ad-a1b6-dcd8689556d6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:16.265547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 184/372] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:08:16 2021] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:16.374786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73cb8-e66f-4222-814e-e22da5e634df None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.375131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73cb8-e66f-4222-814e-e22da5e634df None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.375357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73cb8-e66f-4222-814e-e22da5e634df None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.377612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 189/373] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:16.392795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.393102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.393365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.422725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:16.423932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:16.436694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 185/374] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:16.479718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73cb8-e66f-4222-814e-e22da5e634df None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:16.499197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73cb8-e66f-4222-814e-e22da5e634df None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:16.509481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:16.510175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.510464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.510747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.511520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:16.513421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:16.576449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.sql.core [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 22:08:16.576449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 22:08:16.576449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [parameters: {'id': '7212c5c7f3b94adf8aff152c0f0a47aa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 22:08:16.576449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73764) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 22:08:16.591861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 22:08:16.594047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 190/375] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:08:16 2021] POST /identity/v3/roles => generated 144 bytes in 115 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:16.600982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:16.612295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa51c6-a740-49ac-99c2-b4c81c8c072c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:16.620410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0c4f7-3fcf-49b1-b4b5-50f142fd1dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:16.621334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0c4f7-3fcf-49b1-b4b5-50f142fd1dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.621614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0c4f7-3fcf-49b1-b4b5-50f142fd1dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.621883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0c4f7-3fcf-49b1-b4b5-50f142fd1dc9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.635094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0c4f7-3fcf-49b1-b4b5-50f142fd1dc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:16.642177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f0a0c4f7-3fcf-49b1-b4b5-50f142fd1dc9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 22:08:16.644720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 186/376] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:16.650901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:16.661759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aae29-7d22-43f7-b137-77f456c38463 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:16.666826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:16.667483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:16.667771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:16.668043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:16.668881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:16.669186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:16.670824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d724-25aa-4233-b83c-d82290630740 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:16.679653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 191/377] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:17.685493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7c58-e20e-4a83-b12c-7ae363b6c8b8 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.686011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7c58-e20e-4a83-b12c-7ae363b6c8b8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.686087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7c58-e20e-4a83-b12c-7ae363b6c8b8 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.689766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 187/378] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:17.697234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.697761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.697761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.728279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:17.729755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:17.739771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 192/379] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:17.765015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7c58-e20e-4a83-b12c-7ae363b6c8b8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:17.782452 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7c58-e20e-4a83-b12c-7ae363b6c8b8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:17.786907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:17.787702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.787982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.788256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.809338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:17.816116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:17.817338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 188/380] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:17.824288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:17.833512 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d6fe-f233-4947-b83d-0f59146722af None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:17.838071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:17.838731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.839014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.839290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.840035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:17.840338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:17.841945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:17.850059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 193/381] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:17.856338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:17.866088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d7fd8-54ca-4498-acfd-79f30997aa10 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:17.871095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:17.871872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.872155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.872455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.883731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:17.885585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:17.901896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:17.903368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 189/382] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:17.909385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:17.919851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00975fc-c9a7-4fa3-991a-73a53680e654 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:17.924405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:17.925095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.925378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.925650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.926368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:17.926672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:17.928236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:17.941192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 194/383] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:17.947619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:17.957464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90a904-59c1-4656-86bc-cd6741263cca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:17.965135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:17.965135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:17.965135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:17.965135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:17.984061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:17.986239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.010274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-98b9684b-316a-4a41-8b6a-dafa32e2bbba admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:18.011534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 190/384] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:18.021605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.031749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b66900-0e3a-40d4-b3a5-a3bee8eac42f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.037809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.038524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.038811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.039117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.039951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.040259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.041415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:18.041415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:18.041415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:18.042472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.107243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 195/385] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:18.109534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add5116-d8f5-4146-aa9d-b0cc28fb010e None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.109828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add5116-d8f5-4146-aa9d-b0cc28fb010e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.110112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add5116-d8f5-4146-aa9d-b0cc28fb010e None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.113221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.114737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 191/386] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:18.121240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.121531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.122101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.123993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a18fa9-b71c-4bcb-accf-14f92a8539d9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.130648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.131678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.131964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.132242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.149162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.150928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.157479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:18.158647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:18.168964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:08:18.176665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.181307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:18.193495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec73a2-d7b8-4018-993c-8a7996f64612 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.198227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.199007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.199343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.199621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.209985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.211908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.225067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.237779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaea95-81de-42bd-a731-42c5acbc5e70 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.249032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.249869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.250192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.250471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.255863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:18.257944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 197/389] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:18.266364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.277406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:18.285549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:18.287083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 193/390] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:18.289919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a094-d857-4436-8b33-53f370248190 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.295035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.298484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.299298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.300645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.301122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.301977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.303387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.308315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.312237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4379a-ecd9-44d5-ad04-7addcfd78e87 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.324860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.325759 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.326364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.326650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.327747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.328191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.331938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.336523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 198/391] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:18.344852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 194/392] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:18.345914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.350548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.361652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d52812-e2bb-4544-a918-568bdab714b5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.364946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0de2-01f6-4c4f-a1f5-7b22775b40f3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.366552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.372173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.372707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.373128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.377543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.378349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.378646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.378924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.386484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.388440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.398918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.404596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.434189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:18.435690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 195/393] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:18.443377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:18.444729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 199/394] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:18.448965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.451101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.459280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27d8af-ba3b-4ac1-bf64-12e441bd586e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.464164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.464887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.465205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.465497 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.466304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.466617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.468251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.488925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 196/395] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:18.491020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.502692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaaea5-b7e8-4363-ac76-71dfa92221ef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.507909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.508842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.509130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.509468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.519458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.521623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.536724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-25a353d7-d202-4a4b-a5bc-c6caac4231cb admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 22:08:18.538405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 197/396] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:18.545495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee9a31-dc09-411f-b117-8e2087c09fc3 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.545797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee9a31-dc09-411f-b117-8e2087c09fc3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.546082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee9a31-dc09-411f-b117-8e2087c09fc3 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.547993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 198/397] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:18 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:18.549231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee9a31-dc09-411f-b117-8e2087c09fc3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.563035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee9a31-dc09-411f-b117-8e2087c09fc3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.567606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.568282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.568612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.568892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.569736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.569909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d64759-ef7c-4d80-a1d0-68aa57fad005 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.570058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.571122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:18.571122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:18.571122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:18.572504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.574732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.575474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.575801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.576082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.576994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.577307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.578393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:18.578393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:18.578393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:18.579575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9cbb4-b5c4-4ca5-9465-42a62914a225 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.598799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 200/398] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:18.605355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.605650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.605935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.612048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 199/399] 10.222.0.20 () {56 vars in 1159 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:18.616992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.625400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:18.626641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:18.627598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664d9d0-b688-4b6b-99a8-0f0156a77379 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.632396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.633114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.633404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.633685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.634619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=f9f86a734b484993a795bb8313400e44) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.634936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.635258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 201/400] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:18.636090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.636951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.643010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 200/401] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/role_assignments?user.id=f9f86a734b484993a795bb8313400e44&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:18.645781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c7bad-7dad-4bcf-b238-59ac0e5d3c59 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.651381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.652069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.652385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.652703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.661805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.663657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.675014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 202/402] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:18.681502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.681786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.692452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ea2fa-f531-4e81-a3fe-ecde867abe43 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.697767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf3a0-3f21-41ad-978d-73fc5dba8a4d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.704316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.705469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.705753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.708041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.710730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.712772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.714161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.714724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.734173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.736059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.743743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:18.769748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:18.771661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 201/403] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:18.778502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.783954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:18.796852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 203/404] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:18.802650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf58de-7225-4644-8e2b-13f6dbc5c672 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.808296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.823836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.825802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.826092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.826372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.828177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3314c2-e083-4808-b1f9-7cc43666e88b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.828755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.829078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.833132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.838243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.838931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.839216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.840998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.841657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.844093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.845759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.852489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 202/405] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:18.857133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.862448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:18.871442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.876306 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ec7ce-e1ce-442d-9e72-f47bd40abc7a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.886310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.887144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.887429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.887929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.891279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ed8d-49aa-4ba9-8546-7f26525994a4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.901255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.902665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.902963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.904615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.909099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.913217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.918352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.923609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.946185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:18.949581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:18.949696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:18.950866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:18.956735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.957967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:18.974506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda902cb-4533-4c07-acfc-c60d9b23dc0b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.978079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25fb14-c278-4bf0-8249-f95ea52154f1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:18.983333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.984046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.984338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.984673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.985396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.985763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.987433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:18.990720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:18.991394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:18.991686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:18.991967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:18.993363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:18.993680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:18.995518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.000748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 204/409] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.007958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 206/410] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.008875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.015828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.022692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c7a82-c1aa-4ac6-a5e7-61a6128f6a05 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.026896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149381ca-d716-4c7f-ba0c-73e88165ce62 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.028031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.029183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.029703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.030152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.031759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.032515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.033084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.033447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.034893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=a78f380f9648428989c8f0bbf87921b1) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.035286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.037253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.041074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.043193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.044470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 207/411] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/role_assignments?user.id=a78f380f9648428989c8f0bbf87921b1&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:19.071498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 22:08:19.073157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:19.079720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.098004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733ef6-8c02-4f87-85a9-b45ea9373d0f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.112227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.112950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.113242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.113519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.114363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.114671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.116546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c41edc-9151-44cb-9aa2-695f05140ab3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.152543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 208/413] 10.222.0.20 () {56 vars in 1159 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.159247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.182239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a361a-25c4-439c-a2c9-f87d4ba03efe None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.182649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a361a-25c4-439c-a2c9-f87d4ba03efe None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.182792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a361a-25c4-439c-a2c9-f87d4ba03efe None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.184953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 209/414] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:19.186222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346568-5358-4607-a5b6-bce221ec57ef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.192167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.193156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.193641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.194108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.202820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.203427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.203899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.213064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.219704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.232169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:19.235109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:19.241259 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 206/415] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:19.253485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.254707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 210/416] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:19.269144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11718d-6749-4a67-8c12-17e17f7dfa82 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.276869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.277969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.278549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.279023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.281655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.293723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636f4a-70bd-4b3f-93cc-84a0d3b37659 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.299618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.300665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.300997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.301533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.302010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.302534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.321391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:19.322719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:19.324472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 207/417] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:19.330745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.340539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:19.341776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 211/418] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:19.342355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cefd92-aaa4-480d-b99a-0b0f26f1be2f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.352450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.356761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.358313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.358656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.358939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.359667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.359978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.364726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.368701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d49ea-503b-4e04-856b-7bddb58e6e5f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.378014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.379944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.380240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.380546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.381515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.381825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.385088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.389645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 208/419] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:19.396089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.410777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 212/420] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.413013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.420022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6f0d4-2772-411c-a950-b52e141062a8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.430353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.431151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.431436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.431717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.432076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6238a8-47cc-4106-908a-ef8e5435929e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.441264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.442712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.443000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.443275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.447353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.452010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.465212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.467294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.475577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:19.477683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 209/421] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:19.484895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.490936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:19.496623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 213/422] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:19.504447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.504616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447b68a-66b0-4984-a81c-b223cfa9a3d4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.509258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a337c-c916-43f2-9453-f94865a030f9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.513799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.515150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.515440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.516987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.517261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.518057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.518852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.519131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.519404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.520353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.521482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:19.521482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:19.521482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:19.522807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.523167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.525372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.526130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.556925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 214/423] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.563256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.570605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 210/424] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:19.577441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.578537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061be0-a01a-45b9-a5d6-a685b425f258 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.588976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.590870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.591165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.591683 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.595951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356705c-8d8e-46b9-8f35-aad4cd74cd77 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.606254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.606967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.607251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.608638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.610191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.610854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=bc75144a14f943a7adcb56dfdb808ff1) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.611180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.614919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.615507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2be1-cf1d-42b6-afe0-0280089bf8cb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.627566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 211/425] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/role_assignments?user.id=bc75144a14f943a7adcb56dfdb808ff1&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.635470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 22:08:19.640391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 215/426] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/users/neutron => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:19.643495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0f30-234c-4910-960d-56e162737fe5 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.643689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.643859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0f30-234c-4910-960d-56e162737fe5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.644045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0f30-234c-4910-960d-56e162737fe5 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.645844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 212/427] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:19.653719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.654051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.654277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.654697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23a14-799a-44d3-9cec-61937b4b32a7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.670265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.670958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.672877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.673190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.674071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.674384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.678544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.691195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:19.692431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:19.709860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 213/428] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:19.713278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 216/429] 10.222.0.20 () {56 vars in 1161 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:19.721817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.734261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d74fef-e17e-4c51-84c8-96ab41e9f606 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.735803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.747228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f537e4-b56c-49b3-8849-0c0b0180f554 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.752927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.754877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.755063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.755309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.756901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.758712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.759006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.759287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.774571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.778009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.783661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.785592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.800314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 214/430] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:19.802326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.825040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:19.828860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2715a-f70c-4a3a-9093-d2e2a618d502 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.832563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 217/431] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:19.834352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.835140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.835422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.835697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.839877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.859315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.860226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.863086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90dd2-a495-43bf-b893-e816337aecb5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.881295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:19.881460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.882207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.882705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.883289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.884443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.884933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.885353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 215/432] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:19.887036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.897374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.902158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 218/433] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.908125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.913662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4a53-e89f-4517-b4d1-e8516e80a221 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.923375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.925313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c03f01-5e36-4816-9212-e1051bac32c4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.925449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.925709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.925985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.926715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:19.927726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.930257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.934659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7155-e96e-4b3c-866b-216778b83fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.937451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7155-e96e-4b3c-866b-216778b83fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.937779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7155-e96e-4b3c-866b-216778b83fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.938063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7155-e96e-4b3c-866b-216778b83fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.938775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f7155-e96e-4b3c-866b-216778b83fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.943849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f7155-e96e-4b3c-866b-216778b83fa4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:19.958182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 216/434] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:19.966608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:19.983549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf442a6-83b6-4a3e-8804-da3aac1d5957 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:19.983549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:19.983549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:19.983549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:19.983901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:19.990664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:19.992822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:20.006566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:20.012460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 217/435] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:20.014863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:20.025459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8f57-f0e1-4432-9ea4-b97fdcd7f399 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:20.030032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:20.030728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:20.031016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:20.031297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:20.032079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:20.032449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:20.034388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:20.047191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 218/436] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:20.053839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:20.065450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ceb1e-7a84-4082-b571-6bff525d3ada admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:20.071038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:20.071773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:20.072159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:20.072457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:20.073454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=7c23bd8a1b9c4a1793742ea53c56b0ed) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:20.073775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:20.075960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf27d84-7d95-43d5-b436-a174f23dd99a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:20.082635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 219/437] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:20 2021] GET /identity/v3/role_assignments?user.id=7c23bd8a1b9c4a1793742ea53c56b0ed&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:20.087327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 219/438] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:08:19 2021] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:21.212005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279868-b82c-4125-a7a8-8f3c7856438b None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.212725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279868-b82c-4125-a7a8-8f3c7856438b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.212725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279868-b82c-4125-a7a8-8f3c7856438b None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.214512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 220/439] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:21.221552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.222053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.222217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.244522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:21.245730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:21.259180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 220/440] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:21.306122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279868-b82c-4125-a7a8-8f3c7856438b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.321387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279868-b82c-4125-a7a8-8f3c7856438b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.325720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.326507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.336743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.336743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.338676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:21.345479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:21.347035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 221/441] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:21.352983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.363665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594901-09ab-45e7-a492-4bbd1901adc8 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.372018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.372738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.373026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.373305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.374064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:21.374378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.376019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.385484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 221/442] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:21.391388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.403794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e6c9f-ed23-41ea-9851-5d33b24b548f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.408349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.409186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.409503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.409825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.424153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.426038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.448548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:21.452528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 222/443] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:21.455766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.469568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5122-806b-4aa8-8980-b08b5fd275b7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.480832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.481517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.481805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.482084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.482833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:21.483145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.484794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.502407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 222/444] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:21.508592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.521442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc5bda-cbfe-4c69-a14c-739b2a5c2f92 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.528587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.529379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.529656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.529931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.549652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.551696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.575933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:21.577437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 223/445] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:21.583193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.597583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6974d1-87be-4bca-ade5-b4319bbd6400 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.610022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.610702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.610985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.611256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.612090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:21.612395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.614238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.644111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 223/446] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:21.650036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.665378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886f6d-55e4-4602-8114-fd2f6a64c2ab admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.672455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.673243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.673525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.673800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.697967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.699852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.721581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:21.723116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 224/447] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:21.729975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.745877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982cfd-e492-4f16-a979-a50b17220ce3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.756523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.757190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.757473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.757812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.758543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:21.758851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.760521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a2d00-8769-43bc-8b84-5d6aa85037e4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.779761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 224/448] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:21.787413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.801447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347895a-942c-4272-8a0a-0c956888b5d1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.806073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.806337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b644a-0c21-4ea5-959a-b735700ba43a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.806629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b644a-0c21-4ea5-959a-b735700ba43a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.806850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.807032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b644a-0c21-4ea5-959a-b735700ba43a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.807183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.807421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.808936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 225/449] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:21.815657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.815945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.816229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.825589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.827749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.834371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:21.835593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:21.845782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:21.846967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 225/450] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:21.854431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 226/451] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:21.855384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.866097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f825-0f41-4691-87bb-24808cbe8dce admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.870541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.871178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.871460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.871737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.872535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:21.872847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.874683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.878540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.887689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00db4f6-ba4f-41ea-ac09-8ac737f0207b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.891692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 226/452] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:21.893637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.894421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.894752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.895026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.901739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.906947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677b1d6-1bc0-4cfc-9445-3b3caacb1c9e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.911432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.912343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.912575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:21.912678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.912944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/f9f86a734b484993a795bb8313400e44/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.928533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=f9f86a734b484993a795bb8313400e44, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.929210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:21.930726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 227/453] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:21.931228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.938578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.950771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0037-4a11-4c5c-982e-2176645cce64 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.955607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.956307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.956627 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.956907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:21.971373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:21.971373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:21.971373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:21.971373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 228/454] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:21.976016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:21.986435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04382c-d5a9-4826-9fde-1c720755d8d7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:21.991343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:21.992274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:21.992588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:21.992862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.004168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.006119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.025308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:22.026567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 229/455] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:22.032856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.042960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4e79-0cf1-4f0f-a679-e773c62561ff admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.053060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 227/456] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:21 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/f9f86a734b484993a795bb8313400e44/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:08:22.054686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.055468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.055818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.056160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.057054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.057425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.059227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa3d4-5478-43a4-a069-1c1b49f18325 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.073332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 230/457] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:22.080130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.169578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34620c7-76ef-4526-a752-30d5ba2b8814 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.175016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.175926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.176277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.176683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.187668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace2dc-9ace-4520-8e1e-b0c86d488c7a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.188331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace2dc-9ace-4520-8e1e-b0c86d488c7a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.188854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace2dc-9ace-4520-8e1e-b0c86d488c7a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.189195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.191376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.191621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 231/458] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:22.200133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.200788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.201279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.210272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 22:08:22.216847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 228/459] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/users/glance => generated 84 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:22.218839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.223090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:22.225005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:22.233576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8823c0-b28c-4c11-ad29-ad36b673a400 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.238684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 232/460] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:22.261256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.261951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.262234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.262514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.263369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.263682 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.265590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.266737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.276693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b513e-6f8f-4066-a6f6-08ab65575da3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.284510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 229/461] 10.222.0.20 () {56 vars in 1159 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:22.290653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.291455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.292473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.292932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.293358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.300907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956d0b-62ba-40f2-8fe4-c783cf99522a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.306238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.307130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.307420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.307755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.308858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:22.315729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:22.317182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 233/462] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:22.324711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.327942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.329816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.340956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58efb47-8aea-455b-8054-bc9a276f5c23 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.351608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.357288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.357288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.357288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.357510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:22.357588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.357588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.357725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 230/463] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:22.357791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.361238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.368255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 234/464] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:22.374942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f071ea-c5fc-478f-b49d-516f144f2ef0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.376909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.380028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.380777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.381057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.381379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.382108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.382414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.384699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.391927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abcd48-41df-4d46-8ee3-866aac40082d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.397878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 231/465] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:22.403871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.404288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.405326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.405615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.405896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.414093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2a44-23e2-439c-b56c-8da253a1c1af admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.420441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.420441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.420441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.420441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.422705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.427827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.428470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.430494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.444685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:22.446347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 232/466] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:22.452395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.460442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:22.462209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e05c-f8e1-400b-a040-f8e69a512d40 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.462449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 235/467] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:22.466838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.467542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.467820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.468126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.468966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.469325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.469618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.471366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.484273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 233/468] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:22.485047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d798cb4-eeb6-40c1-a429-35dbf5f8ac90 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.490875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.497942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.498858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.499386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.499882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.500841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.501353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.501623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c625045-8e18-4bfd-8e05-3b1294621301 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.503386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.506356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.512443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.512443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.512443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/a78f380f9648428989c8f0bbf87921b1/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.528444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 236/469] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:22.528610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=a78f380f9648428989c8f0bbf87921b1, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.528610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.529899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.542220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68fbc-9db3-4cf3-b3d9-035f2d498470 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.547049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.547884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.548256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.548659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.557553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.559766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.574365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 22:08:22.575561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 237/470] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:22.581960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.592076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369dada-98e9-48c3-a269-b32ee8d30e10 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.602227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 234/471] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:22 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/a78f380f9648428989c8f0bbf87921b1/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:08:22.604312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.605088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.605371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.605645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.611117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.611117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.611117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.637528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 238/472] 10.222.0.20 () {56 vars in 1159 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:22.643403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.753092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152788-2428-4679-bd5a-98bb365a6aff admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.757746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.758564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.758844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.759119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.770396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.772310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.790823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-a06e22da-eb46-4c81-a169-8d9d210e15b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:22.792399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 235/473] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:22.798449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.810516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3928b-1f29-4166-a38a-a78e8856c7f2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.814957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.815681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.815899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.816175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.816937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.817299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.818949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f018e-fa7a-4c08-8666-f1c7bb996de0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.830533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f165-0704-4fc5-b76e-86219c3420f5 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.830810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f165-0704-4fc5-b76e-86219c3420f5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.831089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f165-0704-4fc5-b76e-86219c3420f5 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.832907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 236/474] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:22.835610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 239/475] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:22.841122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798f165-0704-4fc5-b76e-86219c3420f5 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.846279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.846657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.846942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.854794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798f165-0704-4fc5-b76e-86219c3420f5 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.859238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.860013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.860345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.860655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.870070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.871922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:22.872147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.873358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:22.886079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:22.887501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 237/477] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:22.887631 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 240/477] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:22.893433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.904709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d9eda-15fd-4dc8-aa29-e7c9ae496dbb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.909800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.910447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.910728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.911003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.911181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.911780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:22.912087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:22.913973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:22.922064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c76bc-91a0-41a0-ba7b-90d419bee35b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.926628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 238/478] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:22.933619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.934035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.934535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.934923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.935204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.948581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170948a8-fbc1-47a6-ac43-eec56bfcd0f8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.953365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:22.960208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:22.962001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 241/479] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:22.970845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:22.971744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:22.972028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:22.972305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/bc75144a14f943a7adcb56dfdb808ff1/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:22.982978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:22.997837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dbcf2-3d35-45d6-b84d-d777473b6105 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:22.999320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=bc75144a14f943a7adcb56dfdb808ff1, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.002004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.010627 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.011284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.011575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.011854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.012641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.012997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.014582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.025062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 242/480] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:23.031545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.041662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7abcc2-de0f-4cc9-a838-8295bcb90dee admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.046432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.047380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.047674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.047956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.059632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.061501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.079196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:23.084837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 243/481] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:23.086907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.097183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9e2b8-9093-4fe8-8a9d-d0c7eef5acc1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.101988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.102651 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.102938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.103265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.104278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.104666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.106340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.119134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 244/482] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:23.125219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.135710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365394-12e4-4e35-b13d-1502132c549e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.138632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 239/483] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:22 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/bc75144a14f943a7adcb56dfdb808ff1/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:08:23.194553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.196040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.196328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.196634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.204589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.206660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.221473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 22:08:23.222939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 245/484] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:23.229649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.258440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf2a9b-3412-43a5-bb2a-941130ea9ebd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.268811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.269409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.269696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.269977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.270832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.271148 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.273045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.298031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 240/485] 10.222.0.20 () {56 vars in 1161 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:23.305288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.323198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ede65-713d-48ec-a189-7c7aabd31713 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.335393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.337178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.337739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.338212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.357236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.359493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.382606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:23.385415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 246/486] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:23.390872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.402238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e654d-afb3-452c-8148-a604212de08f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.411155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.411867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.412154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.412460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.413199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.413511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.415660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c92ab-50b7-4b2d-b128-71fc2a43f25d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.428893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 241/487] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:23.435066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.448653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487d48-b03b-4b8a-b34b-14a64fe35536 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.448884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8717-23f3-4514-b9d3-63e52767ebd6 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.449048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8717-23f3-4514-b9d3-63e52767ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.449332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8717-23f3-4514-b9d3-63e52767ebd6 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.451360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 242/488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:23.458685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.458972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.459258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.459758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.460808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.461841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.462363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.478357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.480630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.491573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:23.492863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:23.506030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:23.508928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 247/489] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:23.510247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 243/490] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:23.515480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.527091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285e51c-96b4-4ad9-a066-5703133ff77c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.531861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.532654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.532943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.533220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.534034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.534353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.536251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.549698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 248/491] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:23.557547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.566823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.567517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8d743-3379-4167-b70c-a717b8765555 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.576571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.576571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.576571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.576571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/7c23bd8a1b9c4a1793742ea53c56b0ed/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.582654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb559d1-55a2-4c7e-9c03-ecc64e16c250 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.598160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.599089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.600272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.600729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.605024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=7c23bd8a1b9c4a1793742ea53c56b0ed, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.610369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.621427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:23.628817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:23.630407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 249/492] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:23.637398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.649108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8130-b274-44af-9172-40ead35616b4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.654291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.655200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.655629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.656050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.657081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.657565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.659450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.668767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 250/493] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:23.675178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.685492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ad377-3002-4cc9-b063-8e0418059dab admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.690508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.691522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.691964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.692383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.706957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 244/494] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:23 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/7c23bd8a1b9c4a1793742ea53c56b0ed/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:23.714883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.717145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.736569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:23.743908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:23.752106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.821421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320ebf-ec63-49e6-8940-a3c4b558d529 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.826375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.827280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.827760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.828188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.829121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.829586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.831354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.848546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 245/496] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:23.850897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.861664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaccb36-06c9-4b19-a8ab-7a12044329c4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.866655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.868197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.868772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.869196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.882229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.885415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.902744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 22:08:23.908583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 252/497] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:23.911315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.922275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3e87-0a97-4882-bcee-a3d0fec9a813 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.927292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.928226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.928739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.929163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:23.930782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:23.931262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:23.933407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:23.961499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 246/498] 10.222.0.20 () {56 vars in 1157 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:23.967895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:23.981853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910851d9-f8a9-46a6-963d-8aa5a78288a7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:23.990499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:23.991170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:23.991484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:23.991760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.001105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.002951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.013584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 253/499] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:24.019381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.030975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8dfe6-cf1a-43f8-b018-d1870d4af125 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.037290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.038138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.038466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.038743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.050713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.052654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.071354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:24.072964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 247/500] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:24.079141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.089406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533519-71a8-4d90-b4d0-76bbfa6a55a8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.094034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.094705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.094992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.095270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.096012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:24.096320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.098121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.111500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 254/501] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:24.117608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.127775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc22b5-a84a-4e97-8758-bd242e0112d6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.133353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.134201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.134486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.134813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.142590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.144584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.158611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:24.160095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 248/502] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:24.166975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.177076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd173a7-1fd2-42ea-b196-a7efff78d50e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.181680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.182387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.182630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.182909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.183698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:24.184012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.185912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269fa8-e5d3-44bc-a55a-d2154a792227 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.206625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 255/503] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:24.213602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.224206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e151df-bc06-42d6-a870-cb88dee23508 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.239238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.239238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.239238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.239238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.240079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=e2ff32dae4784d4398bd57d5bd03aaa7) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:24.240395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.242303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059717e-bea8-48c9-ba23-c0efe1d15c53 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.248690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 249/504] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/role_assignments?user.id=e2ff32dae4784d4398bd57d5bd03aaa7&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:24.756128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6dd39-1995-4f66-b9e2-0113d937a663 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.757193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6dd39-1995-4f66-b9e2-0113d937a663 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.758227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6dd39-1995-4f66-b9e2-0113d937a663 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.760520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 256/505] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:24.767553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.768084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.768577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.793440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:24.794981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:24.803222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 250/506] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:24.835428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6dd39-1995-4f66-b9e2-0113d937a663 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.854554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6dd39-1995-4f66-b9e2-0113d937a663 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.859406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.860458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.860936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.861403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.877292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:24.884824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:24.887205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 257/507] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:24.892555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.901780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439648f-df9c-4572-8dbd-ee540afb3768 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.912695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.913362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.913670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.914484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.915240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:24.915544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.917167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.926154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 251/508] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:24.932644 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:24.945289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c634-275f-4735-bb52-3f0f874f2485 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:24.949864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:24.950642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:24.950926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:24.951204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:24.966961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:24.968825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:24.989186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:24.990378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 258/509] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:24.997278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.009360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb46a2-5a9e-4230-be2f-84418885b0a2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.017017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.017675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.017962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.018243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.018958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.019266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.020891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.034107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 252/510] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.040820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.051803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ea3c6-ee47-43cc-bc21-c8a514cc7729 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.058389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.059232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.059522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.059799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.071692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.073860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.089638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:25.091158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 259/511] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.097089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.113383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ca37b-9f41-488e-ab91-f0e24129db14 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.119647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.120364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.120676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.120951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.121838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.122144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.124087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.145141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 253/512] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.151406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.166613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20481bd1-0e36-496d-af5b-3be0ee145d25 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.171505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.172227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.172619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.172957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.182140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.183997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.193617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 260/513] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:25.201506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.213402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108255-3fe8-4d8f-81a4-6188a9fa8bfb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.218040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.219010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.219384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.219793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.231361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.244100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.261790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:25.262991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 254/514] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.269182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.278276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac768e-aa03-4575-b870-e3f4e8df0674 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.282837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.283488 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.283771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.284045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.284858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.285164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.286850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.300208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 261/515] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.306721 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.316846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330625-62b2-4ba9-8028-6184dc36f731 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.322972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.323809 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.324101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.324380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.337171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.339237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.354854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:25.356063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 255/516] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.363226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.377176 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7ac7a-b247-454f-8170-ed4eaab31e58 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.385689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.386421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.386703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.387038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.387830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.388179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.390278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3c1c-ebf3-4f31-8741-977857d252d3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.413760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 262/517] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.421174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.434732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af73d-5fa8-4ea3-aef0-f9b0cae03697 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.444576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.445264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.445549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.445828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.446659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=f9f86a734b484993a795bb8313400e44) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.446973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.448819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b17c-adf5-4788-b7dd-cad40d9c8f05 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.459164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 256/518] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/role_assignments?user.id=f9f86a734b484993a795bb8313400e44&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.475035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f989-dbde-4001-b7fb-45bd8b23a296 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.475367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f989-dbde-4001-b7fb-45bd8b23a296 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.475597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f989-dbde-4001-b7fb-45bd8b23a296 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.477964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 263/519] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:25.486206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.486507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.486771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.504957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:25.506178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:25.514570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 257/520] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:25.540170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f989-dbde-4001-b7fb-45bd8b23a296 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.557239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f989-dbde-4001-b7fb-45bd8b23a296 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.565291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.566114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.566403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.566685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.586234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:25.593333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:25.594942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 264/521] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.602063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.611972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b0be0-d6e0-401e-ae9f-5074973699ea None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.621045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.621737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.622019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.622296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.623059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.623370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.625009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944833-c3d4-4a47-8557-4f1e8b89cdbf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.634084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 258/522] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.641743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.657939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36513-8a10-419c-a8ca-9831ac854033 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.666151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.666958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.667240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.667512 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.681194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bb463-4f7e-4dc7-8be7-dd13197eeb65 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.681528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bb463-4f7e-4dc7-8be7-dd13197eeb65 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.681754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bb463-4f7e-4dc7-8be7-dd13197eeb65 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.683530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 259/523] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:25.683758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.685687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.701397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.701725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.701949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.705254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:25.706769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 265/524] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.715917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.734758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c554b-d386-444d-82f9-5e2a81cb3fd5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.744168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:25.745416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:25.746908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.747585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.747865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.748138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.748902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.749208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.750815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.767028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 260/525] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:25.772792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:25.780158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.790277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e5911-c903-4984-844f-f896a4f982d2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.796784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.797904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.798337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.798759 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.800360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.807869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.810209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.813903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61e78-e2bb-4f4d-879f-1eff347f51c5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.822282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.823087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.823370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.823646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.826754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 22:08:25.828408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 261/527] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.834697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.839078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:25.846208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ceea-db62-41f4-8e12-fbb9e38c8e5f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.846881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:25.848545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 267/528] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:25.853079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.854260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.854687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.854798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.855287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.856266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.856746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.858912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.865742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83fd8-f166-46dc-bc17-f6dcb735e0ba admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.870327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.871082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.871466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.871844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.872736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.873140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.874831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.880663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 262/529] 10.222.0.20 () {56 vars in 1159 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:25.886623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 268/530] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:25.887694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.893670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.898786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fec92-3286-44b8-9437-9d843bef30fa admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.906702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22458a7-0ce2-41a7-9c67-f373337036e1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.907829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.908493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.908778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.909054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.917059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.918244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.918810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.919284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.919385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.921396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.931632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 263/531] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:08:25.932805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.934794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.937904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.946786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f3d54-6fe0-4862-b463-deac9bb8aedd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.952512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.953406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.953814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.954209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.955997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:25.960519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 269/532] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:25.964775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:25.967258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.969245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.976057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a4da-6610-481b-8fab-d50310bacc21 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:25.982657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:25.983521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:25.983978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:25.984468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:25.985357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:25.985837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:25.987564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:25.989028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:25.996842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 264/533] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:25.998001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.006252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 270/534] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.008790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.011886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db323-3564-47c1-a63e-4e3d01b19428 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.016641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.017401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.017636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.017913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.018643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.019768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.021048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816180d-9875-4da7-9318-ac43fbae30e7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.021460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.027086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.028109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.028614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.029575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.034616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 265/535] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.040105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.041142 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.043250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.051369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bc551-9b6d-415b-8358-d4b5fbe2b4c9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.056753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.057652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.057938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.058215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.062115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 22:08:26.068616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 271/536] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:26.069744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.072268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.073519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.085882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f405-c35d-4d60-9e5d-8e7fadd9e55c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.090445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.091106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.091392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.091672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.092623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.092944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.094782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.098945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:26.100764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 266/537] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:26.107894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.120451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 272/538] 10.222.0.20 () {56 vars in 1159 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.122850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7766-8400-4cf7-be17-f2dd6376f957 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.124351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.128613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.129536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.130013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.130495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.131472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.131973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.134646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.135118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f884fd0-2b35-4cea-8107-d4e0f5a00720 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.140073 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.140861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.141151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.141437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.154640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.154640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.155065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 267/539] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:26.156505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.164067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 273/540] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:26.169896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.170791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7222-32b1-4430-9017-f82d293c419d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.175796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.177133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.177523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.178103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.179091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=a78f380f9648428989c8f0bbf87921b1) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.180029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.181174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eb5a5-8639-40ab-bd3d-ebdc7dccfa60 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.183103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.186998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.188181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.188673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.189109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.196454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 268/541] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/role_assignments?user.id=a78f380f9648428989c8f0bbf87921b1&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:26.204550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.206582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.225746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:26.227541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 274/542] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:26.235527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.254067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e1855-e557-40c7-bf29-29033bc17710 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.261971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.262695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.262980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.263263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.264047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.264359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.266067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.284936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 269/543] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.287455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.298331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70405-eaf2-48d1-bd7e-ca50e688d1e5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.317228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.318440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.318926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.319395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.337855 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.340201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.363794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:26.365463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 275/544] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:26.377593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.396954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d34a5-9448-4ead-bc69-ef142536cbd7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.408841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.409635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.409917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.410195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.411081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.411352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.413363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388bdb5-1113-47d6-8169-3756f9afb822 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.432596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 270/545] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.439575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.451691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177ff1-6c44-44e7-9ff3-bf8d72ceae0d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.456743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.457707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.458272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.458761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.459823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=bc75144a14f943a7adcb56dfdb808ff1) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.460344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.463697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0140-edfb-4add-9fa6-b12b0aea6f2f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.476581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 276/546] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/role_assignments?user.id=bc75144a14f943a7adcb56dfdb808ff1&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.665595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204dc0-8ce2-4550-9544-a0d6511a95f9 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.665914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204dc0-8ce2-4550-9544-a0d6511a95f9 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.666161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204dc0-8ce2-4550-9544-a0d6511a95f9 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.668407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 271/547] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:26.675778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.676051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.676331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.697590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:26.698779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:26.708307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 277/548] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:26.733982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204dc0-8ce2-4550-9544-a0d6511a95f9 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.748739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204dc0-8ce2-4550-9544-a0d6511a95f9 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.754712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.755498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.755781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.756055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.768851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:26.776208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:26.777740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 272/549] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:26.784152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.797381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d10e37-b008-4f61-b838-62bd94d26112 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.809071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.809752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.810037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.810315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.811093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.811418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.813127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e651c-d6b0-4d36-b0e2-1a9a2e084d52 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.827275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 278/550] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.833612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.848320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afe3bc-ba37-43d2-af3c-0a9f12b53d15 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.858503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.859309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.859590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.859887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.880216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.882092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.910943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:26.912453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 273/551] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:26.914598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e4494-bb78-4d9d-9189-bbc656dec463 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.914888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e4494-bb78-4d9d-9189-bbc656dec463 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.915170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e4494-bb78-4d9d-9189-bbc656dec463 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.917020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 279/552] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:26.921438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.930952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.931352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.931725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.934986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1fdc7-993d-4938-a4c8-072391de5343 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.940824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.941754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.942039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.942312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:26.943037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:26.943341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:26.945050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:26.961045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 274/553] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:26.967744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:26.974249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:26.975435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:26.982847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b802a8-d811-484f-a4ac-7e7df71dfeea admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:26.991957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:26.993468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 280/554] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:26.993744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:26.994084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:26.994364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.008776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.010851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.030431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 22:08:27.031971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 275/555] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:26 2021] GET /identity/v3/users/neutron => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.037010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.037794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.046887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba770b3-dded-4b1e-8dd4-65a7b32dfe9c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.049487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddec2f-da4d-41c7-bc94-230b881713a2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.054275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.055699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.056597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.057818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.059406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.061099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.062088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.062859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.064204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.065698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.069066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.080968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:27.095557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:27.098491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 281/556] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.104767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 276/557] 10.222.0.20 () {56 vars in 1161 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.108142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.111718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.125011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a8b6-1908-4287-8324-f6838ba900cd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.127786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c05e-1ace-4969-90d3-e8b0a540aba5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.133713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.135000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.136146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.137042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.137911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.138877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.139409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.139787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.140377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.141877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.142757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.157948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.161356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 282/558] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.161898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.172253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.178093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 277/559] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:27.181988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b9ab6-bf4c-4257-b0e4-51447f38a3c6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.185162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.186727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.187623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.188008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.188495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.197901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057de30e-f52d-4d79-8317-9fa666bb2727 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.200002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.201894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.213659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.214429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.214706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.214974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.219845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:27.221174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 283/560] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.227233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.245155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b7830-610a-4989-b74e-85d39cd3f2dc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.245545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.247369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.250252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.251078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.251460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.251834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.252829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.253236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.255132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.268109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 284/561] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.274848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.281170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:27.285379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36415-53e4-462f-8257-f543a4380f54 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.289373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 278/562] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:27.291091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.292163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.292708 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.293185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.295281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.302552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.305451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.319663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 22:08:27.321394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 285/563] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.326203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8041-d8d7-49fb-9bf2-f032c7f9935a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.328078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.338001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.338728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.339011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.339284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.339670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d6b9-035a-4b9d-9fce-86d4ca730fde admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.340009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.340317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.341926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.345373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.346349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.346831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.347370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.348521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.349045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.351774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.370752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 279/564] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.372273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 286/565] 10.222.0.20 () {56 vars in 1157 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.376513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.379001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.389099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6ba2b-2005-40fc-9250-c83dec28168d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.394110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.395210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.395694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.396168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.398874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8038-a318-4b91-9d47-1b7578b213a1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.407664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.410308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.413146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.414462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.414734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.415002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.431807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:27.433570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.433785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 287/566] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.435703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.440472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.450997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0627d03-6723-46b4-8853-1fc3701ca08e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.455994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.456929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.457390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.457810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.458750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.459202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.461057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.476647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:27.476647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 280/567] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.478052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.486614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 288/568] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:27.491080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18f76-786e-47d8-86ba-e97972db5e10 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.493225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.507996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797a7a-762b-4bf4-b33b-39f27076fafb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.512702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.512930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.513376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.513657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.513814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.513947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.514101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.514380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.514715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.515026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.516892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.522085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.524182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.538560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:27.541539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 281/569] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.546583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 289/570] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:27.547119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.552739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.567568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978e0c-8778-4009-9842-759ec215a617 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.570432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cb9d-abcb-4f8c-80ad-9fd61df63c7e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.575493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.576535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.577095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.577590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.578608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.579122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.581452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.589166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.589908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.590273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.590572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.591406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=7c23bd8a1b9c4a1793742ea53c56b0ed) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:27.591698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.593725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e021cd8-ae72-4afb-ba14-09596e9f0ce1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.597469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 290/571] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:27.604454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 282/572] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:27 2021] GET /identity/v3/role_assignments?user.id=7c23bd8a1b9c4a1793742ea53c56b0ed&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:27.605634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:27.622757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9180e-4e73-4944-87c6-8d033e401105 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:27.629983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9558d-76fd-4c12-9df6-3331a9e55582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:27.631268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9558d-76fd-4c12-9df6-3331a9e55582 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:27.631826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9558d-76fd-4c12-9df6-3331a9e55582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:27.632307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9558d-76fd-4c12-9df6-3331a9e55582 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/e2ff32dae4784d4398bd57d5bd03aaa7/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:27.653738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9558d-76fd-4c12-9df6-3331a9e55582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=e2ff32dae4784d4398bd57d5bd03aaa7, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:27.657083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9558d-76fd-4c12-9df6-3331a9e55582 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:27.745554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 291/573] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:27 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/e2ff32dae4784d4398bd57d5bd03aaa7/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:28.691810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0ba7-322d-47f5-b158-6a86ce4ee6b3 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:28.692360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0ba7-322d-47f5-b158-6a86ce4ee6b3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:28.692360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0ba7-322d-47f5-b158-6a86ce4ee6b3 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:28.694430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 283/574] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:28.701831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:28.702256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:28.702440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:28.725405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:28.727137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:28.808583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 292/575] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:28.844864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f0ba7-322d-47f5-b158-6a86ce4ee6b3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:28.866059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f0ba7-322d-47f5-b158-6a86ce4ee6b3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:28.876540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:28.877339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:28.877621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:28.877894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:28.897203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:28.904516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:28.906161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 284/576] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:28.912852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:28.926969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60f40-af1a-4fc8-acac-b59754b8eae1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:28.932260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:28.932982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:28.933268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:28.933546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:28.934326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:28.934633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:28.936268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe33c6-23ed-4a77-99de-6fa8bb96945b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:28.947781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 293/577] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:28.953637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:28.968275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a94b-bb95-48bc-b218-2b533115d5c1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:28.977868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:28.979178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:28.979631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:28.980087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:28.996181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:28.998115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.021090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:29.022574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 285/578] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:29.023462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd747dc-f11e-4f8c-afe3-7f9a3ce6b885 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.023877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd747dc-f11e-4f8c-afe3-7f9a3ce6b885 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.024260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd747dc-f11e-4f8c-afe3-7f9a3ce6b885 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.026342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 294/579] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:29.029026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.033945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1874f09-ee12-4a3b-a52d-3328ed7a513a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.034159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1874f09-ee12-4a3b-a52d-3328ed7a513a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.034540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1874f09-ee12-4a3b-a52d-3328ed7a513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.042127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4abb-95be-44ff-9256-67b142da5ae4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.054882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.055589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.055868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.056191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.056949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.057295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.057405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c1874f09-ee12-4a3b-a52d-3328ed7a513a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:29.058752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c1874f09-ee12-4a3b-a52d-3328ed7a513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:29.058924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.066739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 295/580] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:29.068074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244e03-3b29-43a0-9e2f-87eeeb5dccdf None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.072048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 286/581] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:29.072879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244e03-3b29-43a0-9e2f-87eeeb5dccdf None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.073260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244e03-3b29-43a0-9e2f-87eeeb5dccdf None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.081392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.081905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 296/582] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:29 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:29.091818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.092184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.092557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.102145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7e280-90f8-4047-b643-d50dd31cbbf5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.108080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.109320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.109603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.109881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.114654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:29.116017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:29.118486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.120618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.124574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 297/583] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:29.125569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.134735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:29.134867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939e1e-e962-40d1-963b-ac1609017930 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.136401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 287/584] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:29.142222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.143178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.143525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.143868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.144643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.145573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.145873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:29.145873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:29.145873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:29.146977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.158298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590377-dc2b-4907-834f-174e77b79b75 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.165257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.166193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.166739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.167220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.168287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.168403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 22:08:29.168985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.169611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 298/585] 10.222.0.20 () {56 vars in 1151 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:29.170460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.171525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.180306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb972e-38cc-4336-a8ed-4feb1fb41dc8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.185083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.185840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.186125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.186401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.193833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 288/586] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:29.195029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.197362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.199540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.208529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9b566-e5c1-4e23-850a-74a27d99ebf6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.214224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.215312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.215811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.216365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.217299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.217402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:29.217937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.218604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 299/587] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:29.219447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.219552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:29.219552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:29.219552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:29.220838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.227617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 289/588] 10.222.0.20 () {56 vars in 1146 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:29.232612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56063-ab1d-4925-9f27-7b2619c69a5a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.233651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.243734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.244813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.245295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.245780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.252582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ecee1-5853-4135-ae27-ca3b5d285975 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.256368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.257512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.258223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.258506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.258784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.259330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.259534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.259851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.261606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.268313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 290/589] 10.222.0.20 () {56 vars in 1146 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:29.269270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.270949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 300/590] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:29.282541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb360a-b8a7-4c26-bbab-8c5dfca16f94 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.283489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.287533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.288278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.289286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.289572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.290321 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.296512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.296512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.302020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd7177-7980-4573-b27b-a755991c0c5d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.308205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 291/591] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:29.315118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.318098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.319105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.319565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.320024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.333992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.334295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41dc60-c7db-467d-806b-6ae746d053e2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.337098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.351911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.351911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.351911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.351911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.352278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.352278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.356810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:29.358272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 301/592] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:29.369680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.384510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa02b-ef19-4dc8-9f22-accd207ffca1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.389796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.390483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.390824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.391105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.391948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.392262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.394124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.408656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 302/593] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:29.416041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.426780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c71f4-be6e-413c-ae2c-03e7f74f8f5f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.431691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.432596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.432931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.433210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.441976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.444125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.458600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:29.462158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 303/594] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:29.467361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.473930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 292/595] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:08:29 2021] POST /identity/v3/users => generated 254 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:08:29.481687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac16367-082f-4eac-b58b-510752e2782c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.493137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.494189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.494688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.495239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.496264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.496819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.499109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77af04-2521-4e67-9ace-faa104859bbc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.519551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 304/596] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:29.526617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:29.538115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ddda-8f68-46e7-a468-12354c3bc95e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:29.554418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:29.555089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:29.555375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:29.555642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:29.556496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=f9f86a734b484993a795bb8313400e44) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:29.556825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:29.558643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac45f-e7cc-4953-a2ed-62caa5d54584 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:29.571629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 293/597] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:29 2021] GET /identity/v3/role_assignments?user.id=f9f86a734b484993a795bb8313400e44&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:30.479328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9782-7a21-4554-ac80-478d383d174a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.479839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9782-7a21-4554-ac80-478d383d174a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.479944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9782-7a21-4554-ac80-478d383d174a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.481976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 305/598] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:30.489256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.489745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.489838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.513465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:30.514596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:30.522400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 294/599] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:30.558223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9782-7a21-4554-ac80-478d383d174a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:30.573973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9782-7a21-4554-ac80-478d383d174a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:30.578610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:30.579438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.579731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.580012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] PATH_INFO: `/v3/services/network` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.580704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:30.582288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:30.599227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 22:08:30.600393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 306/600] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:30.607801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:30.617905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7b05-b25d-4902-a39a-f9496d476ef8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:30.629027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:30.629716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.630001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.630277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.631004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:30.631315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:30.633728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca37d9-2f75-4413-8c9f-cad31005cef4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:30.640026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 295/601] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:30.646574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:30.659504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d5d75-ec5d-4eac-a6a9-f5cceab4649c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:30.665143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:30.665859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.666193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.666478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.667188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:30.667498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:30.668516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:30.668516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:30.668516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:30.669399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23778b9-4b6a-42b2-b240-b879831f9964 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:30.681971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 307/602] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/services?type=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:30.724183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a5057-cec8-48e3-ad3c-7cd3e2d304a7 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.724491 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a5057-cec8-48e3-ad3c-7cd3e2d304a7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.724775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a5057-cec8-48e3-ad3c-7cd3e2d304a7 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.727030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 296/603] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:30.735220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.735661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.736041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.763861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:30.765196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:30.779211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 308/604] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:30.816519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a5057-cec8-48e3-ad3c-7cd3e2d304a7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:30.834581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a5057-cec8-48e3-ad3c-7cd3e2d304a7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:30.841326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:30.842240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.842522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.842793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.859032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:30.866068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:30.867829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 297/605] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:30.874437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:30.885988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe25e-50c7-4ff7-90c4-12b72b08ab22 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:30.895805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:30.896663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.897052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.897427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.898321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:30.898831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:30.900610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:30.910929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 309/606] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:30.917672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:30.933008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602b96-ca1d-4839-ad93-4022191f85d2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:30.944558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:30.945467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:30.945750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:30.946089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:30.957929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:30.959886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:30.988942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:30.990529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 298/607] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:30.997162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.016517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae0950-44f7-4349-8c30-c7c1ab0c33a4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.029601 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.030555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.031042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.031518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.032479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:31.033004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.034811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.055068 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 310/608] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:31.061439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.077388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d404-7b3c-4b98-99dc-856600cc02b3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.088645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.089509 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.089795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.090067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.101553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.103563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.127536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 22:08:31.128827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 299/609] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:31.135739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.150906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07e20c-9159-4bbd-85ff-ceb2b7b93730 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.162600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.163588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.164075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.164580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.165621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:31.166129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.168349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.200450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 311/610] 10.222.0.20 () {56 vars in 1157 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:31.200627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.217320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2073-50fe-4f93-a3c5-1ecbfe0a8073 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.229628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.230280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.230561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.230836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.248162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.249949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.266064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 300/611] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:31.272455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.285216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7c1c-2da7-4e9f-a20a-5cd9bb7317e0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.292551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.293395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.293677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.293998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.311694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.313817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.336862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:31.338280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 312/612] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:31.344332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.357469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb203a-e419-4a56-aa9e-44c4b1a5c15e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.369980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.370696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.370983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.371260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.371981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:31.372289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.373891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.393668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 301/613] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:31.400316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.413486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a4004-e78b-42b5-a681-22de48ddbc2b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.422101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.422918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.423202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.423478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.437745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.439777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.455227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:31.456757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 313/614] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:31.464652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.486821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfdfb-d189-474c-a36e-67039c972d64 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.502451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.503114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.503395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.503671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.504486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:31.504803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.506638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e018-c49e-4a95-be41-ff70efad99a5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.526337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 302/615] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:31.532792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.547111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c726f6f-6c74-4503-9ec6-b6824f717fd2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.565229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.566224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.566708 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.567200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.568413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=e2ff32dae4784d4398bd57d5bd03aaa7) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:31.568954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.571019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb87cb-020b-4ec7-a1bb-f86d2170f1ed admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:31.577939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 314/616] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:31 2021] GET /identity/v3/role_assignments?user.id=e2ff32dae4784d4398bd57d5bd03aaa7&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:31.866235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1f8a8-58b7-499d-bb95-b41eeb374e09 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.866640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1f8a8-58b7-499d-bb95-b41eeb374e09 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.866850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1f8a8-58b7-499d-bb95-b41eeb374e09 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.868946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 303/617] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:31.876514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527f8e-ba55-4f1b-8be9-4135d8a2078a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.877079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527f8e-ba55-4f1b-8be9-4135d8a2078a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.877554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527f8e-ba55-4f1b-8be9-4135d8a2078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.897546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4f527f8e-ba55-4f1b-8be9-4135d8a2078a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:31.899600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4f527f8e-ba55-4f1b-8be9-4135d8a2078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:31.914972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 315/618] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:31.939257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1f8a8-58b7-499d-bb95-b41eeb374e09 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:31.957397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1f8a8-58b7-499d-bb95-b41eeb374e09 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:31.962387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:31.963043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:31.963324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:31.963651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:31.964393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:31.966819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:31.966819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:31.966819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:31.967638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec0a22-0d30-41cf-bbd4-15a675e10322 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.102467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 304/619] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:31 2021] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:32.113303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda02f9e-99cb-4c10-9474-7bf78d39ca59 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.113610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda02f9e-99cb-4c10-9474-7bf78d39ca59 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.113867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda02f9e-99cb-4c10-9474-7bf78d39ca59 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.116105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 316/620] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:32.124376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.124684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.124890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.147432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:32.148694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:32.176209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 305/621] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:32 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:32.212189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda02f9e-99cb-4c10-9474-7bf78d39ca59 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.228117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda02f9e-99cb-4c10-9474-7bf78d39ca59 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.235554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.235554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.235554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.235554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.253124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:32.260877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:32.262141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 317/622] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:32.268723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.281687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834121-d2a4-4223-8cbd-4a27d3b72c6c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.286442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.287128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.287410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.287739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.288712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:32.289022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.290636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.305488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 306/623] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:32.311329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.325566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63085bfb-61f9-4c41-ac90-514ef8c1a6d2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.330137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.330975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.331263 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.331541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.346385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.348208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.368744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:32.370429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 318/624] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:32.376344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.390488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a5ce5-b2f2-40b1-b751-8a04c9de6877 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.395141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.395776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.396065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.396347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.397193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:32.397507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.399116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.412373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 307/625] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:32.419091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.430974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c18d-da18-4c51-b02a-e0ca3d53c43a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.436380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.437201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.437482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.437760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.446285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.448285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.461674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:32.463182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 319/626] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:32.469135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.484569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426167-1140-4939-82e9-b32c3ed9aef7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.491537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.492716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.493000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.493279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.494118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:32.494429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.496261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.520517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 308/627] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:32.526835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.543426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724a8c7-b345-4478-96ae-7130bb41d6bf admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.550165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.551299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.551765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.552218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.573391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.575522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.603614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:32.605781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 320/628] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:32.612122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.622840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14591783-6112-4e69-9e0f-247913159f34 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.627697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.628617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.629082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.629536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.630433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:32.630918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.632776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.644739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 309/629] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:32.650986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.661596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05a169-eb35-407b-b87e-a452e485249e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.666993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.668013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.668516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.668973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.676524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.678735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.694121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-e91f0786-79ce-43f0-a736-50b8ebc03eaf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:32.695885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 321/630] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:32.702267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.711285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da86c60-6dd4-4922-aec4-8fb9647e6940 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.711584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da86c60-6dd4-4922-aec4-8fb9647e6940 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.711870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da86c60-6dd4-4922-aec4-8fb9647e6940 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.713248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0fae1-8433-429c-8968-8a129e14e377 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.713930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 322/631] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:32.720568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.721481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.721609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.721773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.722035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.722412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.722862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.723968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:32.724532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.727181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.742573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 310/632] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:32.749653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.754269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:32.755472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:32.762337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435124-09f0-4b9c-91c1-249a477162d0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.767925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 323/633] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:32 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:32.775689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.776613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.776901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.777182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/f9f86a734b484993a795bb8313400e44/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.779161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=f9f86a734b484993a795bb8313400e44, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.781835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.798363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.808102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7e93e-c8ef-435a-91d6-3e2542701a7b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.812906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.813693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.813981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.814262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.828600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:32.832323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:32.833909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 324/634] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:32.841080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.851501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d000f7-a1cf-419c-921d-e765efa193ae admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.856334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.857071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.857356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.857635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.858382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:32.858814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.860395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.869801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 325/635] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:32.875941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.885936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467653-aa21-466b-b767-b0b69f97b034 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:32.891061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:32.891846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:32.892213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:32.892523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:32.904287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:32.906410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:32.924892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:32.926739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 326/636] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:32.928585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 311/637] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:32 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/f9f86a734b484993a795bb8313400e44/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:32.933690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:32.944076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc574-928f-4eb2-821c-d18fd2707ed8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.019274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.020340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.020845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.021316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.022253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:33.023299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.025180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.044010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 327/638] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:33.050304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.071443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d551c8-8312-451a-a33d-19fb7f8932c3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.080555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.081395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.081687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.081982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.097764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.099842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.124545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 22:08:33.131486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 312/639] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:33.132928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.149123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7989e-9443-4261-8799-d253376a09d3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.156703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.157675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.158156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.158628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.159739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:33.160294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.162429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.191279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 328/640] 10.222.0.20 () {56 vars in 1171 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:33.198363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.212821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd45498-6f0c-4043-814c-7c3b4ed79ae4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.220308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.222155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.222155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.222155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.234000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.236092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.246405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 313/641] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/auth/tokens => generated 1171 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:33.258370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.271925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0682-38ed-45e8-9330-8c93eeabc80f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.280760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.281909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.282387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.282887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.298220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.300397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.326190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:33.328761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 329/642] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:33.335053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.349080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1698036-7d9e-4340-90e5-6c86f3a4252a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.361118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.361806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.362088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.362365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.363096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:33.363408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.365185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997acb-c41e-448b-abc5-e472b5888bc2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.381877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 314/643] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:33.388515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.401131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71807c99-017b-4a38-a590-264622472ce1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.409653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.410554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.410841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.411121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.420882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.422923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.429176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38bb50-0deb-4669-83aa-24b932906c38 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.429468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38bb50-0deb-4669-83aa-24b932906c38 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.429752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38bb50-0deb-4669-83aa-24b932906c38 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.431773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 315/644] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:33.439128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.439423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.439699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.442948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:33.445397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 330/645] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:33.452541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.464804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:33.466058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:33.475054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6373b1-0b50-4593-a530-2dad891b18c7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.483495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.486459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.486899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.487413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.488346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:33.489159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 316/646] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:33 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:33.489640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.491778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.512865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 331/647] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:33.519236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.526324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:33.537567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307da6-a956-484a-a8c5-dd694f2fd72b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.542993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504db5b-cd8c-48e7-aaa0-fd49f5ebe752 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:33.548753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.549725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.550241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.550720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.551790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=3265f9ac013c4416ab06bdbdf73bed81) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:33.552858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.555240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c6aa8-d7ad-448a-8a27-22365b0579f4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.560135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:33.561538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:33.562040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:33.562527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:33.563493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:33.564750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:33.564750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:33.564750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:33.565998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1a0b5-e442-41e5-93d4-90511fbda785 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:33.567710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 317/648] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:33 2021] GET /identity/v3/role_assignments?user.id=3265f9ac013c4416ab06bdbdf73bed81&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:33.654922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 332/649] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:33 2021] POST /identity/v3/services => generated 240 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:34.422545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516114a0-d094-476c-9763-f6f006788ec9 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.422914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516114a0-d094-476c-9763-f6f006788ec9 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.423098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516114a0-d094-476c-9763-f6f006788ec9 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.425200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 318/650] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:34.433557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.433848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.434127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.461432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:34.462619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:34.496873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 333/651] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:34 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:34.533166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516114a0-d094-476c-9763-f6f006788ec9 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.554600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516114a0-d094-476c-9763-f6f006788ec9 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.561943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706fa3d-7643-4b34-a1a9-22f1511c95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.562736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706fa3d-7643-4b34-a1a9-22f1511c95e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.563019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706fa3d-7643-4b34-a1a9-22f1511c95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.563297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706fa3d-7643-4b34-a1a9-22f1511c95e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.578437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706fa3d-7643-4b34-a1a9-22f1511c95e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:34.585127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f706fa3d-7643-4b34-a1a9-22f1511c95e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:34.586631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 319/652] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:34.592887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.611293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec11f3-7539-408c-a9b7-a3a7b170a023 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.621291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.622276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.622769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.623309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.624257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:34.624772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.626568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b385e-2575-414a-8674-05136bd9f730 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.635780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e017-4439-4c89-bb6b-ed61f91a838b None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.636075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e017-4439-4c89-bb6b-ed61f91a838b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.636364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e017-4439-4c89-bb6b-ed61f91a838b None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.638484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 320/653] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:34.638923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 334/654] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:34.644468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03e017-4439-4c89-bb6b-ed61f91a838b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.648303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.648806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.649267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.670762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03e017-4439-4c89-bb6b-ed61f91a838b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.673204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:34.675395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:34.678632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.680318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.680806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.681281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.697750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.699258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 335/655] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:34 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:34.701539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.723288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.727604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:34.729741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 321/656] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:34.734013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4a2d1-d9f6-41e3-a708-d014c549bd78 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.737604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.746220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.747427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.747647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.747979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.748666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.750011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059f289-7203-4d16-ac02-14f09291bd2f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.750313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.764388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 22:08:34.767034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.767916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.768448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.768946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.769863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:34.770369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.772154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.775626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 336/657] 10.222.0.20 () {56 vars in 1151 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:34.782149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.798740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 322/658] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:34.801182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b807be0-09cb-43d8-a0cb-3d6ae5be1891 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.804905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.813773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.814684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.815172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.815662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.816602 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:34.817277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.819364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd501a-7354-4484-aa1e-55221a3f278d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.821219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.828274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 337/659] 10.222.0.20 () {56 vars in 1146 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:34.830614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.831698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.832200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.832704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.834288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.846896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.849212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.852464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25e43-390b-43b0-94da-0c9bcd4690a8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.864705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 22:08:34.866647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 323/660] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:34.867835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.872474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.872474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.872474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.872474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:34.872474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.872474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.877171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 338/661] 10.222.0.20 () {56 vars in 1146 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:34.877384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.883146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.893098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad98fcd-c1cb-4daa-a50f-30a91e616ac7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.898094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edbc00-1589-4d63-93e3-c7e8bb1a2ddf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.903865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.904533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.904822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.905099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.905884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] RBAC: Adding query filter params (interface=public, service_id=937ac7234021479c883256a3de6cfdc6, region_id=RegionOne) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:34.906205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.907185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:34.907185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:08:34.907185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:08:34.908051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.911183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.911836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.912118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.912403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.913275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:34.914136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.915936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.927436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 339/662] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/endpoints?service_id=937ac7234021479c883256a3de6cfdc6&interface=public®ion_id=RegionOne => generated 194 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:34.934941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.953229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe537d-242d-4e81-a33c-0f23b77834a4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.954461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 324/663] 10.222.0.20 () {56 vars in 1157 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:34.958374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:34.959273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.959933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.960792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.961075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:34.961758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:34.967855 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:34.974635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8625-e969-465b-a48d-80d700e22e17 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:34.978154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 340/664] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/services => generated 772 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:34.988637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:34.989300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:34.989590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:34.989869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.004911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.006611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.016596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 325/665] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:34 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:35.025633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.037209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748207a-fac9-4e39-9817-4f5a191e7832 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.042995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.043850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.044137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.044476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.058381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.060297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.087794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:35.089146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 341/666] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:35.095724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.109841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f2ff4-ab43-4783-9d40-01d062e6b84e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.118095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.118773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.119055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.119330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.120067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:35.120375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.122041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.143296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 326/667] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:35.150230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.166141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd51b7-cbf0-4408-b87c-6af3138fd1b3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.177258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.178082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.178361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.178630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.186335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.188310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.206339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:35.207733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 342/668] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:35.214937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.230346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf6923-a538-4552-a906-82541bd9cd61 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.240453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.240453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.240453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.240453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.241080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:35.241080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.242251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2a5f5-6927-4c9e-aeaa-c6f1f476eb99 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.263164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 327/669] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:35.270147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.290181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86290e1c-e42f-49d7-b4ff-d5dd134cd8ef admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.305858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.306531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.306817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.307094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.307936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=e2ff32dae4784d4398bd57d5bd03aaa7) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:35.308247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.310128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf6d8-6f6d-42a2-bbfa-bfcd05bd88c2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.321749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 343/670] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/role_assignments?user.id=e2ff32dae4784d4398bd57d5bd03aaa7&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:35.744037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba65f10-6784-4d6e-8405-c04354d9f133 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.744755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba65f10-6784-4d6e-8405-c04354d9f133 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.744755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba65f10-6784-4d6e-8405-c04354d9f133 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.746617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 328/671] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:35.754043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.754887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.755391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.780876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:35.782467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:35.795282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 344/672] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:35 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:35.831941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba65f10-6784-4d6e-8405-c04354d9f133 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.852206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba65f10-6784-4d6e-8405-c04354d9f133 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.859715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.860530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.860818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.861089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.879989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:35.886662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:35.888119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 329/673] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:35.894537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.909264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc14d0-fec1-460d-b666-c5b176994549 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.920037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.920822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.921108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.921382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.922133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:35.922440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.924014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:35.938845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 345/674] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:35.944900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:35.957282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7254d-5a3f-4056-a3ed-2f52cb73219f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:35.964584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:35.965688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:35.966173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:35.966647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:35.988006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:35.990125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.015793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:36.017547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 330/675] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:36.023807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.046846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b9712-3a1a-4263-92ce-7296bda7975a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.061950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.062615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.062904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.063186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.063913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.064218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.065829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.085454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 346/676] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:36.091470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.106089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58c7f9-6773-4b01-940b-4da156284866 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.121211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.122394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.122879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.123354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.137603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.139912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.159404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:36.160668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 331/677] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:36.173717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.185003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b85f5a-6e55-416e-bbae-1817c9d2a4c1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.192604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.193272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.193555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.193832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.194926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.195472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.197856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.231178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 347/678] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:36.238499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.249009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53bb22-f045-424a-ac5d-47e9cb55bdfd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.261040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8140f39-47f4-415e-8e71-a7aa15d77f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.261701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140f39-47f4-415e-8e71-a7aa15d77f65 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.261985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140f39-47f4-415e-8e71-a7aa15d77f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.262262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140f39-47f4-415e-8e71-a7aa15d77f65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.277291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8140f39-47f4-415e-8e71-a7aa15d77f65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.278971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8140f39-47f4-415e-8e71-a7aa15d77f65 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.292746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 332/679] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:36.299135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.309361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95356745-1b1b-445f-b813-d0c8d14fd40e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.321148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.321967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.322256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.322534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.339102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.339276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8ec6-9001-45c4-a5ff-59c97003bab8 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.339504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8ec6-9001-45c4-a5ff-59c97003bab8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.339767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8ec6-9001-45c4-a5ff-59c97003bab8 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.340999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.341805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 333/680] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:36.365226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.365562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.365720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:36.365890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.366905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 348/681] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:36.372883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.382938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13f48-2379-40b2-853b-62cdb7fbbb14 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.387566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.388349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.388678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.388961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.389689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.389995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.391573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.399802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:36.401088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:36.404159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 349/682] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:36.410104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.420371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65619c-991a-487b-92e6-eb465239ba9a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.424265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 334/683] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:36 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:36.429195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.430041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.430329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.430608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.443812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.445915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.472786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:36.474408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 350/684] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:36.481620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.482993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.493234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f6a3-fa5c-443f-8d6d-ea5d804b9529 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.493494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38237-632a-43c5-bc9a-fddb8d3dfd34 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.497939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.498786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.499182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.499582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.509652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.510326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.510604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.510877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.511071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:36.511663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.511970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.513831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.518266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:36.519818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 351/685] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:36.529800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.534484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 335/686] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:36.540662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe662c-078d-4800-b713-4bc219fd8221 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.543590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.545587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.546308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.546598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.546935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.547789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.548101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.549889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.557658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949979-a856-4b74-89a7-1341134c9482 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.559889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 352/687] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:36.566200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.576873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1940-4298-4590-8986-b29676234823 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.578059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.578722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.579001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.579273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.580100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=f9f86a734b484993a795bb8313400e44) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.580408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.581886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.582280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.582729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.583014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.583292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.595278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.596166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 336/688] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/role_assignments?user.id=f9f86a734b484993a795bb8313400e44&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:36.597318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.617234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:36.618835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 353/689] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:36.625453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.636618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52052db5-da6f-4428-ae65-04e62af69d3e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.645440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.646175 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.646462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.646738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.647609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.648490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.650243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.667529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 337/690] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:36.673904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.684332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d31de-ff08-4e4b-becf-32ad5bc52107 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.696749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.697582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.697869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.698146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.708728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.711365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.732365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 22:08:36.738105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 354/691] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:36.744611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.758438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b08cb-2186-4650-801d-8a970bdeb086 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.763235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.763917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.764201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.764509 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.765373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.765685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.767577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8ce07-3ab6-472e-9d5f-44718fbd0e1b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.787738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 338/692] 10.222.0.20 () {56 vars in 1171 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:36.793848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.803895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44a9fd-7174-4448-9d07-d536cc597ec1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.808502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.809326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.809574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.809847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.820986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.822841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.840615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:36.842093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 355/693] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:36.843943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5e79-576b-4ec0-bb10-adf362c9ae2e None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.844237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5e79-576b-4ec0-bb10-adf362c9ae2e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.844566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5e79-576b-4ec0-bb10-adf362c9ae2e None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.846552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 339/694] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:36.851098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.855225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.855514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.855792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.861259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb0d1-03a1-48fa-b2b8-236a74b71d06 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.866792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.867465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.867782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.868032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.868796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.869107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.870764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.877505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:36.878725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:36.888014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 340/696] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:36 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:36.888733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 356/696] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:36.894358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.910386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e845b9-86c2-4b17-8b36-f8bd084b10b3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.923431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.924336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.924666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.924940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.925949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.932928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.934878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.937570 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b8c11-01fa-44b3-8ef5-c473d97d29eb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.942686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.943795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.944310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.944918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] PATH_INFO: `/v3/services/network` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.945874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.947717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.948571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:36.950038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 341/697] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:36.957391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.965238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 22:08:36.966834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 357/698] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:36.972328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca300217-97c5-4248-bf6e-f364b408a2ba admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.973351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:36.977824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.978492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.978776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.979313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.980103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.980409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.982362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:36.986449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350f3be-15ea-4455-b684-2269276b4dbe admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:36.991311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:36.992147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:36.992630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:36.993070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:36.993917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:36.994378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:36.996102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:37.001004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 342/699] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:37.002103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 358/700] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:36 2021] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:37.007790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:37.008610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:37.018851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137a52-0fb8-47ef-801e-b99096013be4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:37.020533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2354-6a73-4f49-b028-8d56a0a09561 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:37.024978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d3e9b-f3fb-453b-8af4-5fb1df8e797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:37.025853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d3e9b-f3fb-453b-8af4-5fb1df8e797c admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.026140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d3e9b-f3fb-453b-8af4-5fb1df8e797c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.026415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d3e9b-f3fb-453b-8af4-5fb1df8e797c admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/3265f9ac013c4416ab06bdbdf73bed81/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.026737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:37.027584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.028012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.028507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.029609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] RBAC: Adding query filter params (type=network) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:37.030954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:37.032725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:37.039949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 359/701] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:37 2021] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:37.044523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d3e9b-f3fb-453b-8af4-5fb1df8e797c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=3265f9ac013c4416ab06bdbdf73bed81, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:37.045632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d3e9b-f3fb-453b-8af4-5fb1df8e797c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:37.046615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:37.057243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44824623-d844-4dc2-a55c-30d14b317dfc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:37.062252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:37.063071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.076311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.076311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.076311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] RBAC: Adding query filter params (interface=public, service_id=e6b1338336574d9586aa88978926d9f4, region_id=RegionOne) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:37.076311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:37.076311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:37.076311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 360/702] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:37 2021] GET /identity/v3/endpoints?service_id=e6b1338336574d9586aa88978926d9f4&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:37.078064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:37.088612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de177e-1aa4-42f4-af8b-8bfedeead2d0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:37.093481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8867c-9082-49a9-b037-325db4e309de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:37.094404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8867c-9082-49a9-b037-325db4e309de admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.094853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8867c-9082-49a9-b037-325db4e309de admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.095342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8867c-9082-49a9-b037-325db4e309de admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.096160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8867c-9082-49a9-b037-325db4e309de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:37.098075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8867c-9082-49a9-b037-325db4e309de admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:37.104723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 361/703] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:37 2021] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:37.143157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 343/704] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:37 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/3265f9ac013c4416ab06bdbdf73bed81/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:08:37.932523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542241c9-2ff2-4a62-bc00-983245123088 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.933046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542241c9-2ff2-4a62-bc00-983245123088 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.933122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542241c9-2ff2-4a62-bc00-983245123088 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.935138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 362/705] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:37.942607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.943031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.943172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.968455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:37.969649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:37.994309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc89066-cb66-4cf7-a916-a731dac028fa None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:37.994854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc89066-cb66-4cf7-a916-a731dac028fa None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:37.995334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc89066-cb66-4cf7-a916-a731dac028fa None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:37.997542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 363/706] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:38.004636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.005171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.005630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.034177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:38.036295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:38.062715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 344/707] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:37 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:38.103624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.113759 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d898c-4791-49af-a4b7-dc546a4533c7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.123228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 364/708] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:38 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:38.124020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.129096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.129600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.130055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.147511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:38.154601 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:38.156302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 345/709] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:38.162674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.173474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103dfde-9eb9-499e-b0ee-620eae2316bc None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.177253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.186047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.186667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.186950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.187223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.187978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.188280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.189255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cc278-4a6a-4915-a0fa-9c706e058017 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.189898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.194727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.195774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.196256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.196788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.197638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.198839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:38.198839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:38.198839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:38.200063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.200583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 365/710] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:38.214005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.215156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 22:08:38.216836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 346/711] 10.222.0.20 () {56 vars in 1151 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:38.223315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.231278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055208bc-b659-4daf-9b8e-342072e74797 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.245312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32eaf3-ea8a-4ac4-875c-6b3486c990ca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.246224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.247059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.247328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.247605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.251576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.252651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.253136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.253624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.254597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.255099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.257502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.262884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 347/712] 10.222.0.20 () {56 vars in 1146 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:38.269122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.271376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.273789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.281880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382101-5c7d-4ee1-b13a-58f5b9b551cb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.293752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.295947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.296466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.296975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.297877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.298413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.300267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.306679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 348/713] 10.222.0.20 () {56 vars in 1146 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:38.311778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:38.311778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 366/714] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:38.313012 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.314754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.326374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f1ddb-41d0-4f3e-9e18-96e900d2326f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.329346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ab7bd-d421-41a1-b9cd-048ac55fdc42 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.336856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.338814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.339480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.339796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.340086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.340370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.341014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.341291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.342015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.342550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.343790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.345360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:38.345360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:38.345360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:38.346225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.347326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.372389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 367/715] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:38.375721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.385558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd495af-57f4-456d-948b-e792e609aab8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.390197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.391134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.391425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.391711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.399458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.401596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.416096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 22:08:38.422628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 368/716] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:38.423854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.434191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60151645-4e21-470d-962a-efae94e135fe admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.438794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.439395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.439738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.440023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.440972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.441282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.443225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.462160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 369/717] 10.222.0.20 () {56 vars in 1157 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:38.468650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.481274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28f3d-0599-4ef2-8e1d-22f4facf55d4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.487146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 349/718] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:38 2021] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:38.502836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.503713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.504003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.504376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.516461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.518391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.537069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:38.542671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 370/719] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:38.546041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.558602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c83778-6acc-49f8-bdbe-cecd5de20f60 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.563267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.564030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.564322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.564667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.565405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.565772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.567537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.586495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 350/720] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:38.594760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.607657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c7133-013b-448a-a57f-fd88b34aea7c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.612923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.613790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.614130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.614415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.623017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.625161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.640078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:38.644903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 371/721] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:38.649016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.659816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebbdd7-a45f-4b03-a588-de35acdb5cc3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.664750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.665481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.665770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.666113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.666972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:38.667291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.669241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc1bb-0ca2-4fc7-978c-af775cda021c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.691960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 351/722] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:38.700050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:38.710997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87116-0fa4-4dbe-98e2-0f0c2ec72208 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:38.715857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071eabf-df5c-4a1b-ba0f-c509d7772ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:38.716824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071eabf-df5c-4a1b-ba0f-c509d7772ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:38.717111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071eabf-df5c-4a1b-ba0f-c509d7772ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:38.717392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071eabf-df5c-4a1b-ba0f-c509d7772ea1 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/e2ff32dae4784d4398bd57d5bd03aaa7/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:38.719481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071eabf-df5c-4a1b-ba0f-c509d7772ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=e2ff32dae4784d4398bd57d5bd03aaa7, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:38.722280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071eabf-df5c-4a1b-ba0f-c509d7772ea1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:38.799114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 372/723] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:38 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/e2ff32dae4784d4398bd57d5bd03aaa7/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:39.373028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00f259-1376-4232-8e8c-d654fcf1fb31 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.373715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00f259-1376-4232-8e8c-d654fcf1fb31 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.373715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00f259-1376-4232-8e8c-d654fcf1fb31 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.375582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 352/724] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:39.383922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.384526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.384526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.413685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:39.414906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:39.491568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 373/725] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:39 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:39.541885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00f259-1376-4232-8e8c-d654fcf1fb31 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:39.558017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00f259-1376-4232-8e8c-d654fcf1fb31 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:39.562564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:39.563366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.563652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.563929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.564613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:39.566221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:39.583774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 22:08:39.585031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 353/726] 10.222.0.20 () {56 vars in 1154 bytes} [Tue Sep 14 22:08:39 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:39.591867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:39.601505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d524d-3160-4e37-8c51-9d0c52c5b507 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:39.606384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:39.607043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.607332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.607599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.608309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:39.608651 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:39.610242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350325-53e3-4f66-8109-8f6854d63f9b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:39.615217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 374/727] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:39 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:39.621831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:39.637206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee064b-497e-4de6-8d23-4234bda7bde6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:39.645001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:39.645660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.645944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.646221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.646928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:39.647237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:39.648882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02709b6-2749-4c33-915b-8919d7f238f9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:39.653671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 354/728] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:39 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:39.876850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a0b8-91dc-46dc-94c5-702311140f5a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.877194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a0b8-91dc-46dc-94c5-702311140f5a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.877360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688a0b8-91dc-46dc-94c5-702311140f5a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.879154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 375/729] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:39.888008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e219af-a536-4b70-88e6-08a4966d8824 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.888338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e219af-a536-4b70-88e6-08a4966d8824 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.888603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e219af-a536-4b70-88e6-08a4966d8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.918346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a3e219af-a536-4b70-88e6-08a4966d8824 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:39.919545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a3e219af-a536-4b70-88e6-08a4966d8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:39.932590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 355/730] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:39 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:39.952282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688a0b8-91dc-46dc-94c5-702311140f5a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:39.965819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688a0b8-91dc-46dc-94c5-702311140f5a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:39.970524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:39.971347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.971665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.971960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] PATH_INFO: `/v3/services/network` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.972689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:39.974331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:39.980829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0aa24-721f-4c43-912d-5b88960b56c2 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.981128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0aa24-721f-4c43-912d-5b88960b56c2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.981391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0aa24-721f-4c43-912d-5b88960b56c2 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.983317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 356/731] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:39.987776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 22:08:39.989095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 376/732] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:39 2021] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:39.990793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:39.996445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:39.996445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:39.996647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.006111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa5f7-72b7-4611-b456-c291c35d7f9a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.010975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.011638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.011927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.012208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.012944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.013257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.014578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:40.015104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.015818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:40.024494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 377/733] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:40.027896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.028284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 357/734] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:39 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:40.038604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd1a4-58b3-46d1-97cf-1484f38d16a5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.043474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.044257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.044660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.044941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.045729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] RBAC: Adding query filter params (type=network) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.046042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.047790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.054076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 378/735] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:40.061037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.065476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.073561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c26cd-aa54-4a47-a7d7-cd3ed3941380 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.075699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4992-e7fc-4481-b17b-c5e565abde8d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.080505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.081395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.081692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.081977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.082501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.083222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.083546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.083882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.084723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.086927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.094182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:40.101677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:08:40.102872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 379/736] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:40.114482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.125091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360f15a-423e-4833-baea-a27936a840a0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.130243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.130875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.131171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.131454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.132329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.132719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.134404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.143899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 380/737] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:40.150838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.161283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50aa9d-c20e-4fd0-af63-c42ae91fd157 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.166777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.167615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.167957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.168304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.179822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.181762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.199856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:40.201453 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 381/738] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:40.214458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 358/739] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:40 2021] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:40.216366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.227943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f318-ba0e-4694-9cf7-ad89eb2cb8c7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.253648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.254400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.254689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.254970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.255746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.256062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.257969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.274032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 382/740] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:40.280265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.291646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970746-69b6-418d-94c5-d141e10c1091 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.296341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.297255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.297586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.297864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.306049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.308086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.324055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 22:08:40.325553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 359/741] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:40.332137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.343390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7070ef6-f96b-41a8-9fcd-5fa64207cbd9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.348337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.349140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.349423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.349740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.350614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.350973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.352919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.373121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 383/742] 10.222.0.20 () {56 vars in 1171 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:40.379568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.390823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127e9a0-68a4-4d2a-be99-606ee000f698 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.395928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.396703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.396995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.397323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.407203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.409070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.419824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 360/743] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:40.426316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.436647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792af2-9f8a-492a-a0cb-318884952cc9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.441659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.442536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.442873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.443159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.455227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.457118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.480790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:40.482371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 384/744] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:40.488406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.498172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a164-d531-4d4d-beaa-62ae8eedbdd8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.503700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.504410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.504725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.505003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.505722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.506098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.508933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.521310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 361/745] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:40.528387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.541672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8789d62-1aab-4474-8c7f-40931a972234 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.546273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.547057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.547340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.547615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.554801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.556826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.570363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:40.571864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 385/746] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:40.578005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.588965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2d323-6daf-496c-b9e8-adf242c4a0fb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.594815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.595710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.596165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.596633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.597629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.598155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.600157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49f89-c9c7-4050-801b-86e596a077f4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.619035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 362/747] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:40.625266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:40.641505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188fa2a-1867-4aeb-941b-a3334a551d38 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:40.648052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:40.648868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:40.649155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:40.649475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:40.650307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=3265f9ac013c4416ab06bdbdf73bed81) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:40.650622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:40.652537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed800ba-be76-4587-8d4e-173ca79daec8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:40.661504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 386/748] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:40 2021] GET /identity/v3/role_assignments?user.id=3265f9ac013c4416ab06bdbdf73bed81&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:41.147162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afd481-a567-46c0-9ed4-0fbbe5ef0b3b None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.147908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afd481-a567-46c0-9ed4-0fbbe5ef0b3b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.148389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afd481-a567-46c0-9ed4-0fbbe5ef0b3b None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.150769 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 363/749] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:41.159069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.159704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.160203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.179373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:41.180910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:41.189108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 387/750] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:41 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:41.212057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afd481-a567-46c0-9ed4-0fbbe5ef0b3b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.224803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afd481-a567-46c0-9ed4-0fbbe5ef0b3b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.230333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.231383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.231901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.232376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.233283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.235081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.249511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 22:08:41.251356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 364/751] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:41.258225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.267236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f507-b68d-4581-86ce-b74b8f1fb3a9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.271745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.272606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.273112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.273590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.274744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:41.275055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.276777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa975-59bb-4ea8-8201-542ed6aced76 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.281801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 388/752] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:41.288355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.298229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad143c9-3c61-48dd-8cb1-2e330114ba05 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.302877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.303575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.304385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.304699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.305443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:41.305752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.307423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d75cc-0bbf-4fbe-a1bd-a3ba928a0be2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.312154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 365/753] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:41.548211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227de0c-8520-4eb9-ae18-0e8ccf67af45 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.548727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227de0c-8520-4eb9-ae18-0e8ccf67af45 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.548802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227de0c-8520-4eb9-ae18-0e8ccf67af45 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.550778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 389/754] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:41.558874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.559442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.559442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.577861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:41.579096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:41.587230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 366/755] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:41 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:41.612323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227de0c-8520-4eb9-ae18-0e8ccf67af45 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.625247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227de0c-8520-4eb9-ae18-0e8ccf67af45 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.629805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.630684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.630970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.631248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.642304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:41.649138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:08:41.650650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 390/756] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:41.657195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.666380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f405a86-5f23-4dd1-9e2f-3fadcec55c53 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.671101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.671766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.672044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.672364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.673190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:41.673493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.675055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.684581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 367/757] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:41.690750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.701720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d089139-88a7-4877-b78f-100ed900b6c0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.706328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.707095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.707376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.707698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.718053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.719975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.737020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:41.738516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 391/758] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:41.745241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.754856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12420-056b-4b36-8d7f-68f21b7ee3bb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.759838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.760525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.760796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.761075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.761785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:41.762097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.763660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.775786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 368/759] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:41.781957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.791830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1f695-20d9-4d3c-9a0c-c5d104946ae0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.802082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.803217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.804094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.804376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.812155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.814284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.828603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 22:08:41.830060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 392/760] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:41.836298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.847385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d872a8e-2327-4a17-befa-6edf6cb25833 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.852802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.853524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.854096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.854379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.855205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:41.855560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.857537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.876101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 369/761] 10.222.0.20 () {56 vars in 1157 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:41.882439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.892339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932b8b9-6635-4a6d-bd56-8f8c1c2dfb58 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.897049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.897776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.898058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.898386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.912584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.912584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.918997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 393/762] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:41.925112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.935448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af380-1e82-4222-af5c-bd435b786a07 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.940100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.940962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.941245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.941515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.951875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.953743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:41.970244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:41.971727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 370/763] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:41.978411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:41.987699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709fdf-5069-4b61-9b6e-de67ac707d7b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:41.993072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:41.993729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:41.994056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:41.994338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:41.995060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:41.995364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:41.996962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:42.009501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 394/764] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:42.015857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:42.026287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf23f-0a85-440f-b97e-969d4d739a22 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:42.031077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:42.031868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:42.032149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:42.032446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:42.040511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:42.042519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:42.056286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:42.057731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 371/765] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:42.064203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:42.074482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62a56-2dc4-4892-b77f-60be3d19f5f3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:42.079498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:42.080186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:42.080528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:42.080879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:42.081807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:42.082123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:42.084087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931134-39ba-437e-b8c3-37c0f105de17 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:42.098504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 395/766] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:42.106101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:42.118375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f510b8-0216-4496-aa3c-4d087e770a4b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:42.122975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:42.123619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:42.123898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:42.124225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:42.125076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=e2ff32dae4784d4398bd57d5bd03aaa7) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:42.125382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:42.127219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28188ee7-ac83-4628-bb11-9759aacf08cc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:42.133479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 372/767] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:42 2021] GET /identity/v3/role_assignments?user.id=e2ff32dae4784d4398bd57d5bd03aaa7&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:42.182363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf83558-2893-48dd-9290-f4a4b4a17d46 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:42.182654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf83558-2893-48dd-9290-f4a4b4a17d46 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:42.182932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf83558-2893-48dd-9290-f4a4b4a17d46 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:42.185053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 396/768] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:42.194527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb4c3-b8dd-4dac-8fc9-3358451fef03 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:42.194830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb4c3-b8dd-4dac-8fc9-3358451fef03 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:42.195080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb4c3-b8dd-4dac-8fc9-3358451fef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:42.214556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-076bb4c3-b8dd-4dac-8fc9-3358451fef03 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:42.215768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-076bb4c3-b8dd-4dac-8fc9-3358451fef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:42.224187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 373/769] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:42 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:42.248973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf83558-2893-48dd-9290-f4a4b4a17d46 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:42.262123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf83558-2893-48dd-9290-f4a4b4a17d46 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:42.266960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfc6a5-4611-4c37-a46b-d4ce4edcb3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:42.267641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc6a5-4611-4c37-a46b-d4ce4edcb3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:42.267975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc6a5-4611-4c37-a46b-d4ce4edcb3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:42.268258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc6a5-4611-4c37-a46b-d4ce4edcb3c2 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:42.269088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc6a5-4611-4c37-a46b-d4ce4edcb3c2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:42.270819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc6a5-4611-4c37-a46b-d4ce4edcb3c2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:42.351092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 397/770] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:42 2021] POST /identity/v3/services => generated 269 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:43.060311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b3388-c900-4393-bad4-8bfddfbe03b3 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.061414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b3388-c900-4393-bad4-8bfddfbe03b3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.061958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b3388-c900-4393-bad4-8bfddfbe03b3 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.064194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 374/771] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:43.072880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.073821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.074303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.092253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:43.093801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:43.111385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 398/772] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:43 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:43.137106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b3388-c900-4393-bad4-8bfddfbe03b3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.150865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b3388-c900-4393-bad4-8bfddfbe03b3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.155575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.156649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.157147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.157634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.168333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:43.175734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 22:08:43.177481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 375/773] 10.222.0.20 () {56 vars in 1142 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:43.184746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.194731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef7dd-e840-4d80-8703-358b9649e6eb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.199637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.200607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.201110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.201614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.202569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:43.203091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.204915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.213956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 399/774] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:43.220270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.230541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53fa0d-fc60-4a2f-bd84-4b0694749760 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.246478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.247576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.248071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.248591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.260168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.262300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.279529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:43.281358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 376/775] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:43.287793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.298463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df85f4-22b4-492e-b008-391614e290d7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.303497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.304462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.304969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.305465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.306406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:43.306920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.308739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.321854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 400/776] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:43.328057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.338652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a714a4-1cff-4ab7-ad62-95b1fd21bc51 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.343978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.344694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.345187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.345666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.354530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.356813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.370921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 22:08:43.376745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 377/777] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:43.379384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.390612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480576-1dfb-4c96-8005-987db5ce8fe4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.395849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.396950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.397999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.398491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.399618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:43.400146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.402350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.422186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 401/778] 10.222.0.20 () {56 vars in 1171 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:43.428820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.439257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b961-98b3-4af0-8635-d940b0df85f1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.445036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.446117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.446604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.447140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.457160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.459439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.470932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 378/779] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:43.477776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.488710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd50078-3a5e-423f-b69b-f83f1b7e5488 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.494029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.495115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.495611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.496096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.507464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.509616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.528236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-9c80c5be-0e8b-4bfd-a2e2-9faf78c461a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:43.530071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 402/780] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:43.536445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.546202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a779-2cdc-403b-bf34-920438b37fca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.551186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.551848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.552137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.552450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.553211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:43.553557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.555184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.556990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7bb7-7324-4143-bf78-5ddc305bad8c None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.557656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7bb7-7324-4143-bf78-5ddc305bad8c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.558346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7bb7-7324-4143-bf78-5ddc305bad8c None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.560712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 403/781] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:43.568149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 379/782] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:43.568858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.569674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.569955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.577679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.588451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac2240-42d5-4a44-b0ea-c4061bc16732 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.593419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.593640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:43.594623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.594927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:43.595349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.595960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.603474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 404/783] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:43 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:43.604588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.606677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.619632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:43.621283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 380/784] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:43.628467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.633827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.637186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967924c-1cda-4a33-99dd-311f7b5557b6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.641902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6eb9-b387-4723-ad53-ede652106a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.642659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6eb9-b387-4723-ad53-ede652106a9f admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.642935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6eb9-b387-4723-ad53-ede652106a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.643221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6eb9-b387-4723-ad53-ede652106a9f admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.643952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf6eb9-b387-4723-ad53-ede652106a9f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.645250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8a11-22fb-4fe0-bc57-0aec74dc8cab admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.645572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf6eb9-b387-4723-ad53-ede652106a9f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.651294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.652020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.652404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.652768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.653659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:43.654029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.655956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.672476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 381/785] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:43.674380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:43.684175 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9df2-0824-427d-86f1-d645976106a0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:43.688884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:43.689518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:43.689804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:43.690082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:43.690895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] RBAC: Adding query filter params (role.id=688185a20bb74ed49e9584d0c5cbd38c, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=3265f9ac013c4416ab06bdbdf73bed81) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:43.691207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:43.693119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803f4b3-2bad-4819-85bc-d4329cee2fd0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:43.699004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 382/786] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:43 2021] GET /identity/v3/role_assignments?user.id=3265f9ac013c4416ab06bdbdf73bed81&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=688185a20bb74ed49e9584d0c5cbd38c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:43.729021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 405/787] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:43 2021] POST /identity/v3/services => generated 251 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:44.429393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b0ba-28fc-4d2b-8215-41749491769e None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.429907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b0ba-28fc-4d2b-8215-41749491769e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.430022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b0ba-28fc-4d2b-8215-41749491769e None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.432008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 383/788] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:44.439465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.439894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.440038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.458077 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:44.459257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:44.480582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 406/789] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:44 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:44.501234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b0ba-28fc-4d2b-8215-41749491769e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.514322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b0ba-28fc-4d2b-8215-41749491769e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.518754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.519556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.519839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.520116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.520814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.522466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.533793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-b1d42060-545a-4ea2-a0d3-ff1ad69df007 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 22:08:44.540527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 384/790] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:44.542074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.551389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcbc1-3069-4ec6-8cd3-3c643214ad8e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.556549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.557214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.557500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.557779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.558557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:44.558799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.560386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.571167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 407/791] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:44.572689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.572970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e7d0-ebe6-4e51-8ded-dfcdf68123a8 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.573267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e7d0-ebe6-4e51-8ded-dfcdf68123a8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.573549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e7d0-ebe6-4e51-8ded-dfcdf68123a8 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.575550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 385/792] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:44.582468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cacab1-90bc-456a-911f-62879b63697a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.583746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.584134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.584612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.587141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.587802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.588091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.588381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.589130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:44.589441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.591026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.596131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 408/793] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:44.605096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:44.606486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:44.620719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 386/794] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:44 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:44.640889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.651530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052d937-90da-4289-918e-36ccddcff379 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.656620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.657465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.657802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.658084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.658812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.660446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.673061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 22:08:44.680703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 409/795] 10.222.0.20 () {56 vars in 1154 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:44.682179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.691724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ab4c-2efe-4da7-a9f4-0934af9e0d00 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.697030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.697717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.698003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.698274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.699001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:44.699310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.701009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.711842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 387/796] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:44.713287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.723525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4176b-9a73-4428-9552-524740407ca3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.728713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.729701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.729988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.730266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.731038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:44.731348 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.733071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.744588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 410/797] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:44.746328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.757457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199095c-eb51-4b62-ac7a-f77d312ccb13 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.763220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60062890-cec2-492c-b881-96171b746bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.763982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062890-cec2-492c-b881-96171b746bff admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.764223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062890-cec2-492c-b881-96171b746bff admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.764528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062890-cec2-492c-b881-96171b746bff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.765380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60062890-cec2-492c-b881-96171b746bff admin admin] RBAC: Adding query filter params (interface=public, service_id=24d0c2755e0c4809875f2360f6b2e7ee, region_id=RegionOne) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:44.765693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60062890-cec2-492c-b881-96171b746bff admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.766753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-60062890-cec2-492c-b881-96171b746bff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:08:44.766753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:08:44.766753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:08:44.767693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60062890-cec2-492c-b881-96171b746bff admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.776493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 388/798] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/endpoints?service_id=24d0c2755e0c4809875f2360f6b2e7ee&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:44.782824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:44.793326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b55c4-e5f5-490d-8ae7-ffeecdbec427 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:44.798103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becebcd-eae8-4cf5-8350-4bc5732e8865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:44.798766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becebcd-eae8-4cf5-8350-4bc5732e8865 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:44.799057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becebcd-eae8-4cf5-8350-4bc5732e8865 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:44.799340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becebcd-eae8-4cf5-8350-4bc5732e8865 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:44.800020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becebcd-eae8-4cf5-8350-4bc5732e8865 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:44.801692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becebcd-eae8-4cf5-8350-4bc5732e8865 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:44.808220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 411/799] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:44 2021] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:08:45.921206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8b1c-64e7-4486-81cc-07fa31d599bf None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:45.921762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8b1c-64e7-4486-81cc-07fa31d599bf None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:45.921762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8b1c-64e7-4486-81cc-07fa31d599bf None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:45.923733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 389/800] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:45.931541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:45.931979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:45.932151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:45.949516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:45.950689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:45.958891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 412/801] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:45 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:45.983858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b8b1c-64e7-4486-81cc-07fa31d599bf None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:45.996912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b8b1c-64e7-4486-81cc-07fa31d599bf None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.001583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e6fbb-73e7-468d-95f4-1fa1a9fb011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.002403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e6fbb-73e7-468d-95f4-1fa1a9fb011a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.002684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e6fbb-73e7-468d-95f4-1fa1a9fb011a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.002956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e6fbb-73e7-468d-95f4-1fa1a9fb011a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.015422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e6fbb-73e7-468d-95f4-1fa1a9fb011a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:46.023155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-8b1e6fbb-73e7-468d-95f4-1fa1a9fb011a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 22:08:46.028676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 390/802] 10.222.0.20 () {56 vars in 1142 bytes} [Tue Sep 14 22:08:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:46.031019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.040565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1606b-445b-45a9-94a5-930dda7f998b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.045169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.045829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.046109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.046382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.047125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.047430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.049027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a981-8c25-4531-9d7f-a44419c6723a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.056753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d763-0daf-4daf-8a7c-a341856635a5 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.057037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d763-0daf-4daf-8a7c-a341856635a5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.057313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d763-0daf-4daf-8a7c-a341856635a5 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.059284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 391/804] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:46.059436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 413/804] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:46.065625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d763-0daf-4daf-8a7c-a341856635a5 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.066662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.066961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.067246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.078134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d763-0daf-4daf-8a7c-a341856635a5 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.082761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.083716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.084153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.085130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.086313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:46.087502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:46.095658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 414/805] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:46 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:46.096699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.098652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.117345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:46.119359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 392/806] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:46.124299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.125592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.129640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0200622-f3fd-45e0-8c1b-5798b4398601 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.134340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.135260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.135648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.136027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.136517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e64b-72ae-4790-86a0-d25a326f4fd6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.136920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.138870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.141415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.142214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.142638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.143052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.143904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.144364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.146081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.152710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 22:08:46.154260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 415/807] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:46.158689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 393/808] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:46.165168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.165318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.175006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220ffb-cd50-4654-b9a2-61a255e372cd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.175285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e78e-b47a-4e98-8014-e7d2e93f7c60 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.180165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.180311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.181076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.181411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.181529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.181903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.182072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.182481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.182874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.183286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.184958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.190150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 416/809] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:46.191198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.193356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.196564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.205626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cce37-109c-4f34-8c23-b3f5bada8bc9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.208435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 22:08:46.210800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 394/810] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:46.212503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.212503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.212503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.212503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.213284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.213709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.215383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.216988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.221429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 417/811] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:46.227140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aa84f-f2f9-4262-8476-ea2fd4310fcb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.229115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.232059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.232747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.233025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.235971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.235971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.235971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.236281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.251139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4122618-85b1-4864-abae-7ed8034a93e9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.256527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 395/812] 10.222.0.20 () {56 vars in 1171 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:46.260493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.262087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.262753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.263042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.263305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.264099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] RBAC: Adding query filter params (interface=public, service_id=6f953aa212a544e9988016100eda1a97, region_id=RegionOne) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.264413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.266024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.273799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a0a3-6b7e-4d4f-9fb6-6dbe0499bbb2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.276728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 418/813] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/endpoints?service_id=6f953aa212a544e9988016100eda1a97&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:46.279959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.282219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.283329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.283868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.284344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.290736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea308c-4bea-446d-9fcf-b4bd25c2ea9b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.296230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.296756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.296962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.297245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.297554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.298226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.299776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.299970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.308563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 419/814] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:08:46.324148 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:46.326156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 396/815] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:46.332174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.343776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c739-9f3f-4e22-8f98-1533a61f6db8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.349381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.350496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.351029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.351645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.352656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.353210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.355506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.369536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 420/816] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:46.377972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.391974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e45290-22d1-47f8-8c4b-c169054fe0e4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.398071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.399584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.400116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.400706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.409114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.411562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.426857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:46.428879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 397/817] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:46.435617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.446971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37106a3c-d9fa-44f6-b340-464307092699 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.452395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.453540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.454027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.454533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.455581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:46.456115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.458249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fdc4-6320-4dc2-a30a-e5eea55e12e9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.476866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 421/818] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:46.480207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.492315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047185f7-3f27-4da5-a045-bb670dbff02e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.497392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5c8ab-5571-4335-b79d-3fc42f223d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.498500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c8ab-5571-4335-b79d-3fc42f223d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.498919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c8ab-5571-4335-b79d-3fc42f223d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.499345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5c8ab-5571-4335-b79d-3fc42f223d87 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/3265f9ac013c4416ab06bdbdf73bed81/roles/688185a20bb74ed49e9584d0c5cbd38c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.501838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5c8ab-5571-4335-b79d-3fc42f223d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=3265f9ac013c4416ab06bdbdf73bed81, role_id=688185a20bb74ed49e9584d0c5cbd38c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.504727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5c8ab-5571-4335-b79d-3fc42f223d87 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:46.578859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 398/819] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:08:46 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/3265f9ac013c4416ab06bdbdf73bed81/roles/688185a20bb74ed49e9584d0c5cbd38c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:08:46.839398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6510-e4db-4fba-aaee-fa4eac3e85e8 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.839688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6510-e4db-4fba-aaee-fa4eac3e85e8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.839967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6510-e4db-4fba-aaee-fa4eac3e85e8 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.842046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 422/820] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:46.849440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348e381-c9cd-4f48-95c2-a2d81428816c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.849729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348e381-c9cd-4f48-95c2-a2d81428816c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.850041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348e381-c9cd-4f48-95c2-a2d81428816c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.868499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6348e381-c9cd-4f48-95c2-a2d81428816c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:46.869684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6348e381-c9cd-4f48-95c2-a2d81428816c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:46.930485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 399/821] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:46 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:46.954817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e6510-e4db-4fba-aaee-fa4eac3e85e8 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:46.967756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e6510-e4db-4fba-aaee-fa4eac3e85e8 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:46.972277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:46.973001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:46.973291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:46.973575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:46.974322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:46.975980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:47.048156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82474f-7442-497c-802b-6622a47ec38d None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:47.048498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82474f-7442-497c-802b-6622a47ec38d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:47.048812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82474f-7442-497c-802b-6622a47ec38d None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:47.050655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 400/822] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:47.057935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:47.058220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:47.058498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:47.071751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 423/823] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:46 2021] POST /identity/v3/services => generated 241 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:47.077231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:47.078445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:47.097116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 401/824] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:47 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:47.122543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:47.135976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b858d-7f64-46b3-9eef-cd88de6440f0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:47.141354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:47.142523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:47.143026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:47.143476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:47.144328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:47.146382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:47.159276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 22:08:47.161242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 424/825] 10.222.0.20 () {56 vars in 1154 bytes} [Tue Sep 14 22:08:47 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:47.168984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:47.179520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5365b-6b4c-49f5-bf88-272eb0a2f1c1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:47.184684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:47.185611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:47.186106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:47.186576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:47.187510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:47.188008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:47.189951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:47.196099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 402/826] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:47 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:47.202796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:47.213892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911101de-4cea-403d-a6af-0006afbc595e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:47.219160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:47.220123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:47.220634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:47.221104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:47.222105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:47.222589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:47.224469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175355e-2ff3-43f6-a0a7-61bc517691cb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:47.232366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 425/827] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:47 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:47.241997 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:47.252582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b8c28-5167-45b3-add1-68f3c4f990e9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:47.257612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43754-8e16-449a-bc95-347eef76b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:47.258469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43754-8e16-449a-bc95-347eef76b40b admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:47.258754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43754-8e16-449a-bc95-347eef76b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:47.259027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43754-8e16-449a-bc95-347eef76b40b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:47.259767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43754-8e16-449a-bc95-347eef76b40b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:47.261361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a43754-8e16-449a-bc95-347eef76b40b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:47.337072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 403/828] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:47 2021] POST /identity/v3/endpoints => generated 347 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:48.555011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd696-1985-40ec-b8a2-1c2d9607ad13 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.555552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd696-1985-40ec-b8a2-1c2d9607ad13 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.555552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd696-1985-40ec-b8a2-1c2d9607ad13 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.557571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 426/829] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:48.565099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.565523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.565726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.583739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:48.585566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:48.603203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 404/830] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:48 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:48.627167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd696-1985-40ec-b8a2-1c2d9607ad13 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.639921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd696-1985-40ec-b8a2-1c2d9607ad13 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.644410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.645222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.645512 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.645792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.646445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:48.648615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:48.659615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 22:08:48.661097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 427/831] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:48.667749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.677554 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da27e2-f02f-426e-8426-4bdf1d6a1615 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.682438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.683127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.683410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.683685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.684508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:48.684821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:48.686471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:48.692786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 405/832] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:48.699740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.710616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13964-e0d1-4b67-a8bf-b940753d6e04 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.715327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.715994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.716282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.716598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.717310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:48.717622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:48.719200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1543c1c-cfec-452a-a09b-f7a6ae3a1a76 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:48.729185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 428/833] 10.222.0.20 () {56 vars in 1136 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:48.735147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.745493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a7c2-4dbb-4145-b0b8-58b28e3eeaa8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.750329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.751200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.751702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.752172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.753170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:48.754945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:48.773557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4732-c7fa-43a7-a0b1-56a984798a41 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.773853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4732-c7fa-43a7-a0b1-56a984798a41 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.774139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4732-c7fa-43a7-a0b1-56a984798a41 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.778119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 429/834] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:48.782799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.783095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.783380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.801380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:48.802686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:48.810591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 430/835] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:48 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:48.821829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 406/836] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:48 2021] POST /identity/v3/endpoints => generated 346 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:48.836523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.846519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7908937-63bd-4e76-a0c6-89b72ee4f2ac None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.862732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.863557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.863838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.864190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.876098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:48.884535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 22:08:48.886170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 431/837] 10.222.0.20 () {56 vars in 1142 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:48.892771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.904155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fbea7-408e-438d-ab83-fa1e5cf58e3e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.908892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.909579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.909860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.910138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.910957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:48.911268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:48.913008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:48.922653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 407/838] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:48.929608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.940247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fd11a-7ab7-4b10-9618-f9cbedb0207f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:48.945585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:48.946385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:48.946668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:48.946940 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:48.958671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:48.960649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:48.979385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:48.981046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 432/839] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:48.987608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:48.998506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f1167-9b53-47d9-bccb-938d9c3fbbec admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.003319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.004038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.004318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.004664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.005392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.005747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.008060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.021222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 408/840] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.027690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.037833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a04172-533c-4b92-97bd-6d0e23b7c6fe admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.042543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.043356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.043644 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.043923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.054040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.056160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.072063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 22:08:49.073898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 433/841] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:49.080281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.090227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2ff67-c8e8-4bba-9d95-48a9439fdb03 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.094934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.095657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.095942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.096221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.097144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.097454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.099400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.118594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 409/842] 10.222.0.20 () {56 vars in 1171 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.124958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.135555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116936af-b9b9-4279-87f5-d40517e31ca3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.140267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.140949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.141234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.141573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.149910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.151725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.162104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 434/843] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:49.168508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.179097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836900a-1468-4aa5-851b-219035dd7b46 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.183996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.184874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.185155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.185490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.197307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.199291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.216634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:49.218293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 410/844] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:49.224122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.244132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c306-ee29-48c0-a065-7610687bcd4c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.250052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.251261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.251866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.252496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.253816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.254536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.258103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.276405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 435/845] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.284144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.294998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4935-082e-4b12-a821-75ec8bfdb175 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.300077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.301033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.301388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.301738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.310313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.312408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.327108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:49.328693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 411/846] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:49.338084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.351040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d798-6f54-437b-a33c-15cdd2864895 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.358190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.359119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.359667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.360154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.361186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.361713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.364679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d6b1a-6fd2-4ed2-871b-0d0eca8bc22d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.382754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 436/847] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.390403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.403623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae2370-160e-4945-8656-a89275d20adc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.404888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e441fd-91a2-4876-a862-a162fdca5ae8 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.405187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e441fd-91a2-4876-a862-a162fdca5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.405565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e441fd-91a2-4876-a862-a162fdca5ae8 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.412923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 437/848] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:49.413044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.413044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.413044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.413044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.413316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] RBAC: Adding query filter params (role.id=688185a20bb74ed49e9584d0c5cbd38c, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=3265f9ac013c4416ab06bdbdf73bed81) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.413657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.416401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.416727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.417001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.418764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.426427 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 412/849] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/role_assignments?user.id=3265f9ac013c4416ab06bdbdf73bed81&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=688185a20bb74ed49e9584d0c5cbd38c => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.439935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:49.441494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:49.450546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 438/850] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:49 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:49.476253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.490304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28004d7c-6c3b-458a-9c80-1ee7319531d4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.496469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.497700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.498220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.498679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.499600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.501594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.514664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 22:08:49.516583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 413/851] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:49.524058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.534212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e1d7-206a-430b-80d2-da5d774490d4 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.539852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.540886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.541353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.541806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.542702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.543212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.545270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0e26-3768-4111-9db1-c6387c086e38 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.551367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 439/852] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.559156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.569896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46065f2-faf7-4f32-818b-6a469e0cdb01 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.575576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.576570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.577044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.577606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.578566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.579072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.581061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.587265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 414/853] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.593482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca96a-fa68-4c23-be44-25f6ad190bac None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.593985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca96a-fa68-4c23-be44-25f6ad190bac None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.594089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca96a-fa68-4c23-be44-25f6ad190bac None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.595805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 440/854] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:49.596897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.605554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.605837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.606091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.609039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d3e1-4d85-4b77-8fdb-5ff8e4b6cc03 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.613886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.614785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.615290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.616327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.617393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] RBAC: Adding query filter params (interface=public, service_id=c0134a81cbf2458c8bf9a151cc9b96c7, region_id=RegionOne) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.617715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.619302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.624894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 415/855] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/endpoints?service_id=c0134a81cbf2458c8bf9a151cc9b96c7&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:49.626291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:49.627473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:49.631029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.635949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 441/856] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:49 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:49.640777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60581-b676-43ec-9e2f-58e0ef14a14a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.645339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.646028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.646273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.646563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.647269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.648885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.655023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 416/857] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services => generated 1497 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:08:49.659654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.672034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddeebd-7281-4748-a9e0-bb91f40b2972 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.676909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.677723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.678654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.678924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.679594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.681245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.693015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 22:08:49.698563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 442/858] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:49.701642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.720448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e940b-1ce5-4a9e-bc2b-845a5c034fb9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.721374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.722128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.722415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.722700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.723494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.723811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.726250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaad17-a250-41fe-a356-7c50a0725480 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.733418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 417/859] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:49.741511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:49.751859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0943f58-09e7-4ea6-b001-44e203aca398 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:49.757227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:49.758206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:49.758634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:49.759172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:49.760031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:49.760562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:49.762410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068a598-ae27-4fea-a594-3a3b196abc22 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:49.767985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 443/860] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:49 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:51.107969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959d8a7-7d6e-4d04-bf95-31f8696b10af None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.108505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959d8a7-7d6e-4d04-bf95-31f8696b10af None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.108615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959d8a7-7d6e-4d04-bf95-31f8696b10af None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.110592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 418/861] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:51.118834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.119534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.119534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.137621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:51.138818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:51.146927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 444/862] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:51 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:51.172171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959d8a7-7d6e-4d04-bf95-31f8696b10af None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:51.185109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959d8a7-7d6e-4d04-bf95-31f8696b10af None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:51.189575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:51.190236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.190523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.190805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.191507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:51.193382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:51.194778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.common [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 22:08:51.263295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.sql.core [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 22:08:51.263295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 22:08:51.263295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [parameters: {'id': 'e26d78d07abb47b8afdd4d6b5c1fdb93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 22:08:51.263295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73765) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 22:08:51.278569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e26d78d07abb47b8afdd4d6b5c1fdb93.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e26d78d07abb47b8afdd4d6b5c1fdb93. Sep 14 22:08:51.280245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 419/863] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 14 22:08:51 2021] POST /identity/v3/projects => generated 262 bytes in 108 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:51.286730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:51.296521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52911af-4b59-4ad5-b7a7-5f074901ebcd None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:51.301299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:51.302098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.302385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.302665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.309976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:51.311951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:51.324883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-7b6060c2-3d70-4c69-b02a-ca3ae93aef21 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:51.326387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 445/864] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:51.333020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:51.343855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194ef19-e914-4046-bdbc-4dae595300e9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:51.348502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:51.349166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.349457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.349739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.351056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:51.351365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:51.353504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103ded-87e9-47b0-b1c6-4caed6c34e64 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:51.375753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 420/865] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:51 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:51.709762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb64b-cac4-4fff-b806-e98d1107c65c None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.710101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb64b-cac4-4fff-b806-e98d1107c65c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.710295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb64b-cac4-4fff-b806-e98d1107c65c None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.712291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 446/866] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:51.719810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.720104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.720384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.739040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:51.740608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:51.748595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 421/867] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:51 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:51.771527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb64b-cac4-4fff-b806-e98d1107c65c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:51.784817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb64b-cac4-4fff-b806-e98d1107c65c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:51.789368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:51.790176 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.790469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.790746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.791444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:51.793064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:51.804972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 22:08:51.806600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 447/868] 10.222.0.20 () {56 vars in 1127 bytes} [Tue Sep 14 22:08:51 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:51.815175 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:51.824803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b33f-9e9d-4c4a-a8a9-5de987b26ba3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:51.829533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:51.830183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.830612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.830785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.831460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:51.831761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:51.833416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d183d-bc27-48d5-b56c-be0eb0f7a070 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:51.839194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 422/869] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:51 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:51.845303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:51.855462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf2ac-b62c-4f54-9f59-55bad7d0cbb2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:51.860235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:51.860964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.861246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.861576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.862280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:51.862589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:51.864247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fce4e-15f8-4254-89f4-4f5966d3bdc9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:51.869102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 448/870] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:51 2021] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:51.989555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c21b2-3554-4e06-81c9-efde7bf5bae0 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:51.989863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c21b2-3554-4e06-81c9-efde7bf5bae0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:51.990044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c21b2-3554-4e06-81c9-efde7bf5bae0 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:51.993003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 423/871] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:52.001289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf000b-52d1-4d70-abfc-3cea88af63d3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.001645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf000b-52d1-4d70-abfc-3cea88af63d3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.001849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf000b-52d1-4d70-abfc-3cea88af63d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.021235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-42bf000b-52d1-4d70-abfc-3cea88af63d3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:52.022546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-42bf000b-52d1-4d70-abfc-3cea88af63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:52.036516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 449/872] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:51 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:52.055176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c21b2-3554-4e06-81c9-efde7bf5bae0 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:52.068133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c21b2-3554-4e06-81c9-efde7bf5bae0 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:52.073590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:52.074238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.074517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.074793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.075627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:52.077141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:52.081110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f27d-6c67-4b08-9bc9-364f5308b7a5 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.081407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f27d-6c67-4b08-9bc9-364f5308b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.081870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25f27d-6c67-4b08-9bc9-364f5308b7a5 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.083881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 450/873] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:52.091461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.091770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.092024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.109720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:52.110886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:52.119341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 451/874] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:52 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:52.143478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:52.152536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526723d9-e641-4158-b09c-a3a6fcd081ab None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:52.156995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:52.157786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.158069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.158346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.159175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:52.160617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:52.171808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 424/875] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:52 2021] POST /identity/v3/services => generated 242 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:52.178671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 22:08:52.178671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 452/876] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:52.183982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:52.207617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85abe57-0a96-4f11-9ea6-a06a4c41e752 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:52.212898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:52.213580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.213910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.214236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.215015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:52.215380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:52.217160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:52.223193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 425/877] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:52.230295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:52.245971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13ca5-f646-486a-84ad-9181ffd15acc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:52.252450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:52.252450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.252450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.252450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.252904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:52.252904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:52.252904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68268c-7917-414a-9eca-91a9801bf791 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:52.257593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 453/878] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:52.265100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:52.275911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d575-edba-4321-8bdb-911d7ca7b5ef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:52.281017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048d8c-f664-4709-a2ab-e8cb57e33e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:52.281682 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048d8c-f664-4709-a2ab-e8cb57e33e0f admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:52.282022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048d8c-f664-4709-a2ab-e8cb57e33e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:52.282297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048d8c-f664-4709-a2ab-e8cb57e33e0f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:52.283115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048d8c-f664-4709-a2ab-e8cb57e33e0f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:52.284886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048d8c-f664-4709-a2ab-e8cb57e33e0f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:52.378669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 426/879] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:52 2021] POST /identity/v3/endpoints => generated 349 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:53.645765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f9ba-f0cb-4dd1-bbce-e9e4335d5653 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:53.646356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f9ba-f0cb-4dd1-bbce-e9e4335d5653 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:53.646356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f9ba-f0cb-4dd1-bbce-e9e4335d5653 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:53.648895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 454/880] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:53.656322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:53.656804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:53.656984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:53.676670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:53.677878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:53.694828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 427/881] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:53 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:53.720639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350f9ba-f0cb-4dd1-bbce-e9e4335d5653 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:53.733589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350f9ba-f0cb-4dd1-bbce-e9e4335d5653 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:53.738013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:53.738669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:53.738957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:53.739234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:53.739935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:53.742318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:53.743775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.common [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 22:08:53.792462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.sql.core [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 22:08:53.792462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 22:08:53.792462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [parameters: {'user_id': 'ac61f48291864a1fa39209a8d7f60ad7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 22:08:53.792462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73764) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 22:08:53.798566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 22:08:53.800588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 455/882] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:08:53 2021] POST /identity/v3/users => generated 160 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:53.807890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:53.817628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842be6b-737d-456f-92ef-3c671004d495 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:53.823433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:53.824276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:53.824604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:53.824983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:53.832872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:53.834949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:53.849603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-382abed9-b4e3-43bb-b27f-20478e24857e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 22:08:53.851754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 428/883] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:08:53 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:53.858827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:53.870920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400be9-0ea4-4ccd-affa-728f9864466f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:53.875677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:53.876336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:53.876654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:53.876997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:53.877811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:53.878130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:53.880207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e711a3-6a63-456a-b484-4883a870b503 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:53.920099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 456/884] 10.222.0.20 () {56 vars in 1123 bytes} [Tue Sep 14 22:08:53 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:54.108596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefa888-9b98-4526-98bd-9cce4d59da98 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.108893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefa888-9b98-4526-98bd-9cce4d59da98 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.109176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefa888-9b98-4526-98bd-9cce4d59da98 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.111132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 429/885] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:54.118904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f7981-2532-4667-9244-40d62b7d82ce None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.119488 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f7981-2532-4667-9244-40d62b7d82ce None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.119978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f7981-2532-4667-9244-40d62b7d82ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.139010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b03f7981-2532-4667-9244-40d62b7d82ce None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:54.140909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b03f7981-2532-4667-9244-40d62b7d82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:54.149999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 457/886] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:54 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:54.176301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefa888-9b98-4526-98bd-9cce4d59da98 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.190337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefa888-9b98-4526-98bd-9cce4d59da98 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.196462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7d5b7-86af-48d7-b310-b332be7fbde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.197287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7d5b7-86af-48d7-b310-b332be7fbde8 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.197673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7d5b7-86af-48d7-b310-b332be7fbde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.198020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7d5b7-86af-48d7-b310-b332be7fbde8 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.198828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7d5b7-86af-48d7-b310-b332be7fbde8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.200774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7d5b7-86af-48d7-b310-b332be7fbde8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.292381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 430/887] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:54 2021] POST /identity/v3/services => generated 242 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:54.432673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ef37-6aab-4cc7-9103-5aafe5f72bfc None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.433024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ef37-6aab-4cc7-9103-5aafe5f72bfc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.433197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ef37-6aab-4cc7-9103-5aafe5f72bfc None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.435000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 458/888] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:54.442947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.443274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.444105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.462386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:54.463561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:54.480546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 431/889] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:54 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:54.505490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6ef37-6aab-4cc7-9103-5aafe5f72bfc None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.518674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6ef37-6aab-4cc7-9103-5aafe5f72bfc None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.523386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.524208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.524503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.524779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.525442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.527082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.538193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 22:08:54.539549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 459/890] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:54.545919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.555253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085ea6-b30c-4cb1-ad22-c64cc208e4a9 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.560233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.560918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.561198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.561468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.562168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:54.562472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.564030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce0a5-c429-4ce2-8fc8-12471eec6fc0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.569732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 432/891] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:54.575757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.585538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7cd8f-3915-4d79-9609-78e48d504ced admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.590354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.590567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216de0-60b3-4df8-b8d2-8bcdfcd20faf None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.590845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216de0-60b3-4df8-b8d2-8bcdfcd20faf None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.591022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.591115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216de0-60b3-4df8-b8d2-8bcdfcd20faf None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.591296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.591577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.592285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:54.592634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.593031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 433/892] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:54.594287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.600292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 460/893] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:54.600904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.601192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.601576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.607141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.617092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4175e6f-726c-4487-a72e-97af285f6e3e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.619795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:54.620985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:54.621770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.622419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.622708 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.622989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.623767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] RBAC: Adding query filter params (interface=public, service_id=c337b8bb7de044b7b6732722b348156b, region_id=RegionOne) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:54.624082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.625682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.628758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 434/894] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:54 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:08:54.630841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 461/895] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/endpoints?service_id=c337b8bb7de044b7b6732722b348156b&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:54.636910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.646105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba683-b727-4ce8-9726-f3be1cea792a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.650596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.651373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.651874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.652152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.652539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.652978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.654457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.666829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 435/896] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:08:54.667432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216de7f0-d931-4336-89c0-2f4838347989 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.667432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.668339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.668727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.669073 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.669804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.671497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.683992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 22:08:54.685463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 462/897] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:54.692517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.702558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c636f-550f-4f57-98c9-992a23b9b5d1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.707102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.707775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.708056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.708331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.709133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:54.709438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.711057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.716838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 436/898] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:54.723581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.734986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd67a7-fcc3-485b-8b5a-9358a270bae1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.739788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.741074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.741362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.741639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.742363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:54.742671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.744450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.751120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 463/899] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:54.757252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.767333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18027-1199-4138-ade3-337d37920e7a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.772112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.772884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.773239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.773581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.774457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] RBAC: Adding query filter params (interface=admin, service_id=c0134a81cbf2458c8bf9a151cc9b96c7, region_id=RegionOne) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:54.774861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.776558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec192c-9b4f-4cca-8193-d67b1fe92f87 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.782391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 437/900] 10.222.0.20 () {56 vars in 1271 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/endpoints?service_id=c0134a81cbf2458c8bf9a151cc9b96c7&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:54.789538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:54.799304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5074b-4ded-4285-a1e7-fa3ed79a9d5c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:54.804561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a554a8-75c1-4b6e-b995-e3003b1c8c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:54.805236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a554a8-75c1-4b6e-b995-e3003b1c8c6c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:54.805520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a554a8-75c1-4b6e-b995-e3003b1c8c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:54.805794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a554a8-75c1-4b6e-b995-e3003b1c8c6c admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:54.806479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a554a8-75c1-4b6e-b995-e3003b1c8c6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:54.808065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a554a8-75c1-4b6e-b995-e3003b1c8c6c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:54.815331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 464/901] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:54 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:08:56.500899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631147d7-8e13-4755-a8db-9e208a778dda None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.501977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631147d7-8e13-4755-a8db-9e208a778dda None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.502103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631147d7-8e13-4755-a8db-9e208a778dda None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.504043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 438/902] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:56.511405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.511872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.512076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.530236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:56.531430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:56.539946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 465/903] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:56 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:56.563609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631147d7-8e13-4755-a8db-9e208a778dda None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.576064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631147d7-8e13-4755-a8db-9e208a778dda None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.580555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.581335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.581616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.581886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.582530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.584922 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.595525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 22:08:56.596918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 439/904] 10.222.0.20 () {56 vars in 1127 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:56.604078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.613228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1815ef6-b3b5-45c3-9d5f-3fc45603549d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.617864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.618535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.618822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.619102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.619808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:56.620117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.621746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.626960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 466/905] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:56.632997 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.642600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed445-8fd6-4f9a-b31b-3d6605d2b330 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.647673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.648321 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.648639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.648917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.649613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:56.649920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.651523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.656471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 440/906] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:56.663477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.673152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ecb8-7d46-4c9e-a2a1-9d4d6fd42bd8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.677891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.678543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.678827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.679103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.679892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] RBAC: Adding query filter params (interface=public, service_id=30ffca82b3c7436688cd9791c739c48c, region_id=RegionOne) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:56.680206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.681813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45658d92-7bae-4ac2-89c5-5bed1646d6d8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.687296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 467/907] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/endpoints?service_id=30ffca82b3c7436688cd9791c739c48c&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:56.693148 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.702883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520e6b-7a90-4c55-a72f-94f453097942 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.707406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2450473-50bb-4ae3-b1fb-6dbc797af6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.708065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2450473-50bb-4ae3-b1fb-6dbc797af6ee admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.708349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2450473-50bb-4ae3-b1fb-6dbc797af6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.708653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2450473-50bb-4ae3-b1fb-6dbc797af6ee admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.709857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2450473-50bb-4ae3-b1fb-6dbc797af6ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.711430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2450473-50bb-4ae3-b1fb-6dbc797af6ee admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.718369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 441/908] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:08:56.850229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351def-2284-496c-9e72-63b786afce2d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.850554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351def-2284-496c-9e72-63b786afce2d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.850806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd351def-2284-496c-9e72-63b786afce2d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.852837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 468/909] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:56.860712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.861017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.861292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.879705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:56.881508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:56.889889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 442/910] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:56 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:56.914894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351def-2284-496c-9e72-63b786afce2d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.927646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd351def-2284-496c-9e72-63b786afce2d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.932020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.932847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.933136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.933416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.934077 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.935657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.947001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-2c6df5d7-b7d7-4913-a88b-99c69ac17e54 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 22:08:56.948328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 469/911] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:56.954803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.964321 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ff71-4287-4f26-93fe-71e0c6feaa03 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:56.968869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:56.969530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.969816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.970095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.970800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:56.971111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:56.972788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:56.982029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 443/912] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:56.983949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c265-20d2-4d54-80e4-b9a9cfd99b97 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.984321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c265-20d2-4d54-80e4-b9a9cfd99b97 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.984705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c265-20d2-4d54-80e4-b9a9cfd99b97 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.988344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 470/913] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:56.988481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:56.994806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:56.995093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:56.995483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:56.997833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a06f-f569-46c9-954f-53d28f7e7a31 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:57.002555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:57.003216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:57.003506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:57.003789 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:57.004563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:57.004895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:57.007027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:57.012172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 444/914] 10.222.0.20 () {56 vars in 1134 bytes} [Tue Sep 14 22:08:56 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:57.018625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:57.020883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:57.022681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:57.028612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb92197-8485-4727-80a4-9b06f867289e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:57.030655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 471/915] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:56 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:57.033245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:57.033887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:57.034174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:57.034453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:57.035187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:57.036795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:57.054453 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:57.063210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1a202-767b-4e19-ab55-856fb9dbe0fa None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:57.067716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:57.069042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:57.069324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:57.069594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:57.070235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:57.071799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:57.082666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 22:08:57.084585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 472/916] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 14 22:08:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:57.090967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:57.100341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237bbf-d5b2-409a-8a12-19dcb7d6591b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:57.105093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:57.105717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:57.106007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:57.108493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:57.108493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:57.108493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:57.108864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:57.117653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 473/917] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:57.119841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:57.128873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f13ae-d70c-4606-98eb-cb4b0bd786ce admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:57.130171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 445/918] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:57 2021] POST /identity/v3/endpoints => generated 334 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:08:57.145417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:57.146103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:57.146452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:57.147272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:57.148001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:57.148369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:57.150130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e21b-9407-4b72-a91b-f17f5113efd4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:57.156066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 474/919] 10.222.0.20 () {56 vars in 1144 bytes} [Tue Sep 14 22:08:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:57.162698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:57.173645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6a0e-9c3d-44d1-8206-bf82187ac4b9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:57.178937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dbf37-eef0-4a15-a51b-c7059a3d8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:57.179691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dbf37-eef0-4a15-a51b-c7059a3d8f82 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:57.180052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dbf37-eef0-4a15-a51b-c7059a3d8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:57.180410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dbf37-eef0-4a15-a51b-c7059a3d8f82 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:57.181276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dbf37-eef0-4a15-a51b-c7059a3d8f82 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:57.183034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dbf37-eef0-4a15-a51b-c7059a3d8f82 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:57.252796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 446/920] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:57 2021] POST /identity/v3/endpoints => generated 325 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:58.897234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d531f-e462-463f-b75c-726a2a908925 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:58.897750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d531f-e462-463f-b75c-726a2a908925 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:58.897827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d531f-e462-463f-b75c-726a2a908925 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:58.899717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 475/921] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:58.907157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:58.907603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:58.907778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:58.925113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:58.926292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:58.944691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 447/922] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:58 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:58.968454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d531f-e462-463f-b75c-726a2a908925 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:58.980758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d531f-e462-463f-b75c-726a2a908925 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:58.985117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:58.985886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:58.986170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:58.986442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] PATH_INFO: `/v3/services/image` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:58.987081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:58.988853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:58.999981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 22:08:59.001359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 476/923] 10.222.0.20 () {56 vars in 1127 bytes} [Tue Sep 14 22:08:58 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:59.008353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.017356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511df82-18b9-40b5-85ab-18ca291a8836 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.021909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.022635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.022989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.023337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.024134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] RBAC: Adding query filter params (name=image) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:59.024533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.026186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.031433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 448/924] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:59.037556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.047266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffde28-e4d7-4041-ad6f-0054b510cdce admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.051785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.052463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.053279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.053561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.054263 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] RBAC: Adding query filter params (type=image) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:59.054573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.056146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383259f-4459-430a-b6c7-0b7bc280491b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.061332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 477/925] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:59.067329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.077590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6173f-bbdd-481d-be8a-4203fa478c3b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.082044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dea59-e5f6-4f1e-96f8-a812947aecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.082691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dea59-e5f6-4f1e-96f8-a812947aecbb admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.082975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dea59-e5f6-4f1e-96f8-a812947aecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.083251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dea59-e5f6-4f1e-96f8-a812947aecbb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.084032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dea59-e5f6-4f1e-96f8-a812947aecbb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.085643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dea59-e5f6-4f1e-96f8-a812947aecbb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.207318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 449/926] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:08:59 2021] POST /identity/v3/endpoints => generated 327 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:08:59.392613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f14630-f1bd-4888-bfc2-8c7597f69a7f None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.392904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f14630-f1bd-4888-bfc2-8c7597f69a7f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.393183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f14630-f1bd-4888-bfc2-8c7597f69a7f None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.395012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 478/927] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:08:59.403556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca621-c548-436f-8ae5-0a28b5fb5b09 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.403893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca621-c548-436f-8ae5-0a28b5fb5b09 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.404114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca621-c548-436f-8ae5-0a28b5fb5b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.423172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7d4ca621-c548-436f-8ae5-0a28b5fb5b09 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:59.424620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7d4ca621-c548-436f-8ae5-0a28b5fb5b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:59.442515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 450/928] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:59.467699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f14630-f1bd-4888-bfc2-8c7597f69a7f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.475022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad83a0-21ea-46be-ab78-0aaf6d8dc766 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.475520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad83a0-21ea-46be-ab78-0aaf6d8dc766 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.475806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad83a0-21ea-46be-ab78-0aaf6d8dc766 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.477875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 451/929] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:08:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:08:59.480936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f14630-f1bd-4888-bfc2-8c7597f69a7f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.485054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.485329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.485450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.485615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.486124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.486409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.486688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.497439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:08:59.502973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:08:59.504142 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:08:59.504754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 22:08:59.506158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 479/930] 10.222.0.20 () {56 vars in 1142 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:59.512583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.513348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 452/931] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:08:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:08:59.522701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ccf5-09b3-4cb7-bbc5-c5cd81d8b2ed admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.527343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.528175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.528670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.529120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.530041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:59.530520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.532237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.539095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.541589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 480/932] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:59.547578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.548181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621960-6021-4d87-9709-3872d2735a3d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.552797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.553634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.553916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.554192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.555376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.557099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.558023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887ef8b-7597-4d03-b021-a4cf8f4326f4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.563909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 453/933] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:59.564526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.565309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.565590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.565848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.565949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.575760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ecf3-2a1e-453e-a49c-736fe20d2e1d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.576477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.578290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.581294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.582171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.582678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.583165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.584640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.586667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.594544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:59.595724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 481/934] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:59.602837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.612538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d406d-7d41-486f-8ffc-def52e48d85d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.617133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.617775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.618059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.618338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.619053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:59.619392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.620961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.633330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 482/935] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:59.642970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.649646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0d698-3944-4f4b-9811-d3cf80f3fd3b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.654189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.654938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.655225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.655501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.663066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.669362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.678216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:08:59.679360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 483/936] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:08:59.685844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.690630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 454/937] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:08:59 2021] POST /identity/v3/projects => generated 311 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:08:59.698458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630a62a-213b-4694-b60f-263661fdb36c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.762712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.763738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.764175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.764647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.765653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:59.766163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.768268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.792464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 484/938] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:08:59.795861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.806878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427161c-1d54-47b9-aed0-99e939b482d8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.814228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.815530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.816026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.816493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.826516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.828577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.839600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 455/939] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:08:59.846339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.857088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb37a6-857c-4bb9-a8d6-d4ab301b12e9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.862782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.863574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.863878 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.864148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.875290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.877168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.894705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:08:59.895885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 485/940] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:59.902818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.913741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3d3d4-a141-4529-8771-429e779e947a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.919212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.919899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.920248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.920608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.921359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:08:59.921671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.923256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.936220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 456/941] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:08:59.942599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:08:59.952991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574bba-aa9e-464d-89c6-ea12658405b3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:08:59.957720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:08:59.958534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:08:59.959374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:08:59.959678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:08:59.967286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:08:59.969313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:08:59.983379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:08:59.984777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 486/942] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:08:59.991066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:00.000952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddaf5-3457-48b3-831f-14a62d2fa5f0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:00.005484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:00.006805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:00.007158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:00.007503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:00.008351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:00.008757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:00.010787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bc2bd-a10d-4c1f-b455-a72c382b857a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:00.023839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 457/943] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:08:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:00.030820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:00.041136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288911-7c4c-46bd-b03e-1db791fb0a53 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:00.045754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:00.046500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:00.046888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:00.047269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:00.048195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] RBAC: Adding query filter params (role.id=688185a20bb74ed49e9584d0c5cbd38c, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=f9f86a734b484993a795bb8313400e44) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:00.048673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:00.050604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c996-915a-4a95-9ceb-acd71394997f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:00.056488 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 487/944] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:00 2021] GET /identity/v3/role_assignments?user.id=f9f86a734b484993a795bb8313400e44&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=688185a20bb74ed49e9584d0c5cbd38c => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:01.416242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ed3f-c215-4c33-9927-9b096d078cc3 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.416818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ed3f-c215-4c33-9927-9b096d078cc3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.416818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ed3f-c215-4c33-9927-9b096d078cc3 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.418734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 458/945] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:01.425712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.426103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.426275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.443810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:01.445001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:01.452752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 488/946] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:01.475630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ed3f-c215-4c33-9927-9b096d078cc3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:01.487935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ed3f-c215-4c33-9927-9b096d078cc3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:01.492702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61fb00-15e8-4f91-84cc-645524f28635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:01.493338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61fb00-15e8-4f91-84cc-645524f28635 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.493677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61fb00-15e8-4f91-84cc-645524f28635 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.493952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61fb00-15e8-4f91-84cc-645524f28635 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.501571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61fb00-15e8-4f91-84cc-645524f28635 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:01.503297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61fb00-15e8-4f91-84cc-645524f28635 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:01.512141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 459/947] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:01.518737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:01.527489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbb17b-e37a-460f-b2f1-10dd78c3cc27 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:01.531930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf42765-40ba-4def-a8f0-95a99c36a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:01.532740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf42765-40ba-4def-a8f0-95a99c36a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.533024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf42765-40ba-4def-a8f0-95a99c36a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.533296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf42765-40ba-4def-a8f0-95a99c36a5b1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.534432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf42765-40ba-4def-a8f0-95a99c36a5b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:01.536094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf42765-40ba-4def-a8f0-95a99c36a5b1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:01.538483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 489/948] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:01.911104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104645e7-5837-433a-8356-f69fb34a2e46 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.911395 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104645e7-5837-433a-8356-f69fb34a2e46 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.911677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104645e7-5837-433a-8356-f69fb34a2e46 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.914119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 460/949] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:01.921727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.922023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.922306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.939395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:01.940597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:01.948204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 490/950] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:01.975010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104645e7-5837-433a-8356-f69fb34a2e46 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:01.987235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104645e7-5837-433a-8356-f69fb34a2e46 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:01.991674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ae3a1-5ef4-4c68-8098-67ebd90f0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:01.992475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae3a1-5ef4-4c68-8098-67ebd90f0ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:01.992765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae3a1-5ef4-4c68-8098-67ebd90f0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:01.993045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae3a1-5ef4-4c68-8098-67ebd90f0ff9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:01.994206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae3a1-5ef4-4c68-8098-67ebd90f0ff9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:01.995885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae3a1-5ef4-4c68-8098-67ebd90f0ff9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:01.998611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 461/951] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:02.004392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.013137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4914fe-2253-4f14-923f-c0b9285dfb3c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.017642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c085f9-7146-4df8-8dd1-285c2bef2108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.018313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c085f9-7146-4df8-8dd1-285c2bef2108 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.018674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c085f9-7146-4df8-8dd1-285c2bef2108 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.018954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c085f9-7146-4df8-8dd1-285c2bef2108 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.019661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c085f9-7146-4df8-8dd1-285c2bef2108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.022070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c085f9-7146-4df8-8dd1-285c2bef2108 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.115146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 491/952] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:09:02 2021] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:09:02.190749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51242cc-16c3-4608-bf27-b47e72592d6f None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.191011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51242cc-16c3-4608-bf27-b47e72592d6f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.191303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51242cc-16c3-4608-bf27-b47e72592d6f None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.193693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 462/953] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:02.201733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.202023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.202303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.221965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:02.223175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:02.231241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 492/954] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:02.255161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51242cc-16c3-4608-bf27-b47e72592d6f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.268000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51242cc-16c3-4608-bf27-b47e72592d6f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.272980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.273792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.274081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.274363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.284668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:02.295594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 22:09:02.296833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 463/955] 10.222.0.20 () {56 vars in 1142 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:02.303745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.313346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbe95b-25d3-424f-8d9b-1ee37ad47255 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.318555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.319213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.319535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.319769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.320574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:02.320880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.322467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.330576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 493/956] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:02.337692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.348141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcb026-a685-462e-837e-c7845d6769c4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.353964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.354745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.356490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.356490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.365711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.367556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.384693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:09:02.385912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 464/957] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:09:02.392262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.402534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7927205-8cc1-47f2-9491-c4a088adfe5d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.407083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.407805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.408159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.408464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.409180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:02.409489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.411048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.422469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 494/958] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:02.429191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.438870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237d27-2656-449d-bb62-1b8043ab67e9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.447865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.447865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.447865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.447865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.453275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.455279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.469444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:09:02.470573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 465/959] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:02.476881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.486752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280de1-18d6-4324-ba4f-11453ac44c36 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.491774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.492457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.492747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.493027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.493864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:02.494173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.496041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.513320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 495/960] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:02.519590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.529040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca351-98f4-4118-88fb-0a5688a5f57b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.533550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.534323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.534603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.534875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.544889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.546698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.563678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:09:02.564888 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 466/961] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:02.571933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.583772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b26ae-d034-4c70-ba6e-b270fdc4263a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.588263 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.588956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.589297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.589576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.590281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:02.590589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.592140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.603499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 496/962] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:02.609708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.619583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9915d6-7ce1-45ef-931b-dc1781bc0749 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.623992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.624779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.625061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.625331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.632430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.634364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.646721 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:09:02.647983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 467/963] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:02.653861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.663279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db3c0-3863-4b60-b963-de95e8183024 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.667758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.668398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.668712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.668993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.669774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:02.670088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.671899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9e835-4bf6-4ad9-a2e8-980cbec4adae admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.683862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 497/964] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:09:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:02.689908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:02.700390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211879e-0609-43f4-99d5-fb10912ed948 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:02.704810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae529d0-8ace-4d60-8996-407c3fe8eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:02.705647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae529d0-8ace-4d60-8996-407c3fe8eb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:02.705926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae529d0-8ace-4d60-8996-407c3fe8eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:02.706195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae529d0-8ace-4d60-8996-407c3fe8eb75 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/f9f86a734b484993a795bb8313400e44/roles/688185a20bb74ed49e9584d0c5cbd38c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:02.708319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae529d0-8ace-4d60-8996-407c3fe8eb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=f9f86a734b484993a795bb8313400e44, role_id=688185a20bb74ed49e9584d0c5cbd38c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:02.710948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae529d0-8ace-4d60-8996-407c3fe8eb75 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:02.782389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 468/965] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:09:02 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/f9f86a734b484993a795bb8313400e44/roles/688185a20bb74ed49e9584d0c5cbd38c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:09:04.317720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666719d4-6a28-4e75-845c-cfb8d530ff54 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.318857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666719d4-6a28-4e75-845c-cfb8d530ff54 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.318857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666719d4-6a28-4e75-845c-cfb8d530ff54 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.320668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 498/966] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:04.328056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.328512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.328659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.346119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:04.347323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:04.403454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 469/967] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:04.429245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666719d4-6a28-4e75-845c-cfb8d530ff54 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.441174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666719d4-6a28-4e75-845c-cfb8d530ff54 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.445582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.446443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.446792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.447134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.456984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:04.463670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:04.464872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 499/968] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:04.471600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.481289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c33bb-5444-46ac-be6c-a98eb7aee51d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.485860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.486519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.486806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.487085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.487839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:04.488165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:04.490309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:04.498489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 470/969] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:04.504629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.514681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894158-0a2c-4016-aa84-cdfda40d65fc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.519203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.520054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.520401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.520710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] PATH_INFO: `/v3/users/29d17efac01a47f69d2962f6181b8618` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.533438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] RBAC: Authorizing `identity:get_user(user_id=29d17efac01a47f69d2962f6181b8618)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:04.535548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:04.542839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 500/970] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/users/29d17efac01a47f69d2962f6181b8618 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:04.543995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.554021 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9febfb-c9da-4f93-aa5e-3b2cba04b173 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.558513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.559155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.559443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.559724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.567414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:04.569222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:04.577955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 471/971] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:04.584377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.593798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dff7-9e31-4733-8d6f-eba6e938fe51 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.598270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf80716-a20d-4b3f-84a8-0282c56e4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.599629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80716-a20d-4b3f-84a8-0282c56e4d40 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.599918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80716-a20d-4b3f-84a8-0282c56e4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.600200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80716-a20d-4b3f-84a8-0282c56e4d40 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.601514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf80716-a20d-4b3f-84a8-0282c56e4d40 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:04.603834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf80716-a20d-4b3f-84a8-0282c56e4d40 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:04.605554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 501/972] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:04.611861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.621156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bec7d-30a7-428b-9874-73915166bb66 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.625686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.626323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.626611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.626895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.627717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=2fa0f9f83e164243a5099ad7faeebf70, user.id=29d17efac01a47f69d2962f6181b8618) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:04.628033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:04.629889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3060e-db9c-4f4a-9e20-0e327d1e7621 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:04.635487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 472/973] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/role_assignments?user.id=29d17efac01a47f69d2962f6181b8618&scope.project.id=2fa0f9f83e164243a5099ad7faeebf70&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:04.918900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2884fad-ef0f-4a80-a89b-fa56c24f5ac7 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.919184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2884fad-ef0f-4a80-a89b-fa56c24f5ac7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.919460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2884fad-ef0f-4a80-a89b-fa56c24f5ac7 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.921412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 502/974] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:04.928181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.928621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.928975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:04.946361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:04.947554 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:04.955371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 473/975] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:04.981483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2884fad-ef0f-4a80-a89b-fa56c24f5ac7 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:04.993712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2884fad-ef0f-4a80-a89b-fa56c24f5ac7 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:04.998090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:04.998882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:04.999172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:04.999456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.009631 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:05.016838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 22:09:05.018144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 503/976] 10.222.0.20 () {56 vars in 1142 bytes} [Tue Sep 14 22:09:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:05.024985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.033927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b91-fcf0-4e40-8077-85e97493bb13 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.039168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.039910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.040260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.040637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.041446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:05.041819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.043460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.055773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 474/977] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:05.063826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.074491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df268d9-764b-47a8-9d2e-14bd478ac99c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.079042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.079806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.080093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.080370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.097864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.099713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.116120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:09:05.117285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 504/978] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:05.123410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.133212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e3bf-e4cb-479f-b1db-de07138f0399 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.137640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.138282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.138568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.138842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.139549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:05.139852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.141437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.157980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 475/979] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:05.159065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.168394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acca40-b04d-4315-8cf8-f67430f70da9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.172983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.173698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.173986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.174266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.181308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.183277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.196972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 22:09:05.198092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 505/980] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:05.204025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.213873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd095fc9-5328-4c43-a8e4-0716f28759bf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.218297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.218943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.219225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.219501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.220320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:05.220656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.222511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.240014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 476/981] 10.222.0.20 () {56 vars in 1155 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:05.247604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.257648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a1872-42c6-4915-a317-49bcef1440ba admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.262194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.262829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.263118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.263396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.271719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.273482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.282312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 506/982] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:05.288583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.298083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaf0c0-ef90-406e-aec2-9abd5e0ea4c1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.302562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.303428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.303776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.304117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.317712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.321474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.342550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:09:05.343735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 477/983] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:05.350163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.359359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf2ab5-e0b6-43a9-b0e0-874cb6d9c3e5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.363997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.364827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.365183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.365530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.366315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:05.366695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.368368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.379593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 507/984] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:05.386417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.395960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63a35-937a-4112-977d-b2e6cc85077f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.400951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.401718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.401998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.402267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.408905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.410834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.423237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:09:05.424522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 478/985] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:05.433027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.442492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ec461-a9b7-4853-a837-b33dafa6b490 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.447546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.448190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.448523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.448803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.449573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:05.449880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.451677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5362aa-41b0-48fd-bd46-2591fb17b8cf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.463188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 508/986] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:05.469741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:05.480085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bc1e4-f1c5-48be-955e-6c6ca4f4d587 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:05.484711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:05.485340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:05.485622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:05.485896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:05.486705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] RBAC: Adding query filter params (role.id=688185a20bb74ed49e9584d0c5cbd38c, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=f9f86a734b484993a795bb8313400e44) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:05.487012 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:05.488839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a13b2-fe7b-4cf3-bd1f-5cc58420db79 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:05.495738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 479/987] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:05 2021] GET /identity/v3/role_assignments?user.id=f9f86a734b484993a795bb8313400e44&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=688185a20bb74ed49e9584d0c5cbd38c => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:06.767969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c483bd-5716-49d1-af70-b92ee9cffb96 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.768527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c483bd-5716-49d1-af70-b92ee9cffb96 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.768527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c483bd-5716-49d1-af70-b92ee9cffb96 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.770309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 509/988] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:06.777391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.777824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.777959 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.795658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:06.796878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:06.805094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 480/989] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:06.827902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c483bd-5716-49d1-af70-b92ee9cffb96 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:06.839574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c483bd-5716-49d1-af70-b92ee9cffb96 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:06.843827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:06.844616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.844901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.845178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.855618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:06.862290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:06.863400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 510/990] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:06.870057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:06.878666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9504c-2ff8-460e-bb03-078e2cbf39e3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:06.883182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:06.883824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.884112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.884390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.885158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:06.885467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:06.887056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:06.895023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 481/991] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:06.901019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:06.910552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e917-8da7-4bc2-9771-0cd32f31148b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:06.915617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:06.916455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.916742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.917021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] PATH_INFO: `/v3/users/29d17efac01a47f69d2962f6181b8618` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.918211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] RBAC: Authorizing `identity:get_user(user_id=29d17efac01a47f69d2962f6181b8618)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:06.920324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:06.921925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 511/992] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:06 2021] GET /identity/v3/users/29d17efac01a47f69d2962f6181b8618 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:06.928761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:06.938363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07d93-15c7-4159-a5ea-00e2094fd8c0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:06.942915 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bbcb8-07cb-4d2b-b19c-1f8645f9e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:06.943758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bbcb8-07cb-4d2b-b19c-1f8645f9e0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.944047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bbcb8-07cb-4d2b-b19c-1f8645f9e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.944330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bbcb8-07cb-4d2b-b19c-1f8645f9e0f1 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.945533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bbcb8-07cb-4d2b-b19c-1f8645f9e0f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:06.947568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bbcb8-07cb-4d2b-b19c-1f8645f9e0f1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:06.949246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 482/993] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:06 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:06.955461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:06.965321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969812b6-37a1-4191-ba47-0a8db856a204 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:06.969791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92044f-1c83-4e75-a5b0-998af3f39f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:06.970652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92044f-1c83-4e75-a5b0-998af3f39f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:06.970939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92044f-1c83-4e75-a5b0-998af3f39f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:06.971213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92044f-1c83-4e75-a5b0-998af3f39f36 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70/users/29d17efac01a47f69d2962f6181b8618/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:06.973141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92044f-1c83-4e75-a5b0-998af3f39f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa0f9f83e164243a5099ad7faeebf70, user_id=29d17efac01a47f69d2962f6181b8618, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:06.976397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92044f-1c83-4e75-a5b0-998af3f39f36 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:07.054101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 512/994] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:09:06 2021] PUT /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70/users/29d17efac01a47f69d2962f6181b8618/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:09:09.151120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc303-5497-42b7-ab8c-ffb01cefaa63 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.151675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc303-5497-42b7-ab8c-ffb01cefaa63 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.151675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc303-5497-42b7-ab8c-ffb01cefaa63 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.153457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 483/995] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:09.160355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.160806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.160984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.178428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:09.179603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:09.233208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 513/996] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:09.259058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc303-5497-42b7-ab8c-ffb01cefaa63 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:09.271381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc303-5497-42b7-ab8c-ffb01cefaa63 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:09.275777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:09.276592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.276885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.277168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.287051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:09.293715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:09.294846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 484/997] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:09.301311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:09.310526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2913f8-f7fd-4485-836f-e7fe72841582 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:09.315041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:09.315693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.315979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.316260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.317045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:09.317361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:09.319575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:09.327539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 514/998] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:09.333737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:09.343605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f654b2f-4996-4455-a707-c65b2aa50b2c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:09.348159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:09.349019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.349305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.349579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] PATH_INFO: `/v3/users/29d17efac01a47f69d2962f6181b8618` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.350881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] RBAC: Authorizing `identity:get_user(user_id=29d17efac01a47f69d2962f6181b8618)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:09.353035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:09.354840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 485/999] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:09 2021] GET /identity/v3/users/29d17efac01a47f69d2962f6181b8618 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:09.360911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:09.370860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57951f-9148-4294-ad52-07cbba253b26 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:09.375387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:09.376004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.376289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.376603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.384779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:09.386507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:09.395208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 515/1000] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:09 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:09.401385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:09.410681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0b208-5ffb-4f4a-9d4b-15cc5dc9dc3d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:09.415161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c762-bbb9-4e05-a977-da67600c82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:09.415979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c762-bbb9-4e05-a977-da67600c82e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.416264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c762-bbb9-4e05-a977-da67600c82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.416576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c762-bbb9-4e05-a977-da67600c82e5 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.417723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c762-bbb9-4e05-a977-da67600c82e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:09.419810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c762-bbb9-4e05-a977-da67600c82e5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:09.421445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 486/1001] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:09 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:09.428130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:09.436547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a00cc-ca8c-4893-9cc6-f9d215e92767 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:09.441093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:09.442094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:09.442094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:09.442258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:09.443663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=2fa0f9f83e164243a5099ad7faeebf70, user.id=29d17efac01a47f69d2962f6181b8618) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:09.443975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:09.445808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e76a-4100-4b65-a194-af0e6374e9d9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:09.451320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 516/1002] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:09 2021] GET /identity/v3/role_assignments?user.id=29d17efac01a47f69d2962f6181b8618&scope.project.id=2fa0f9f83e164243a5099ad7faeebf70&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:11.596716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d83e5-b165-41e5-a901-cd3675a7fd5a None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:11.597241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d83e5-b165-41e5-a901-cd3675a7fd5a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:11.597354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d83e5-b165-41e5-a901-cd3675a7fd5a None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:11.599669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 487/1003] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:11.606888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:11.607308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:11.607444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:11.625211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:11.626417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:11.633912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 517/1004] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:11.659420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d83e5-b165-41e5-a901-cd3675a7fd5a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:11.671864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d83e5-b165-41e5-a901-cd3675a7fd5a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:11.676154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85d348-672e-48fe-8496-3d75e8db8c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:11.676946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d348-672e-48fe-8496-3d75e8db8c4f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:11.677235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d348-672e-48fe-8496-3d75e8db8c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:11.677536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d348-672e-48fe-8496-3d75e8db8c4f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:11.678685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85d348-672e-48fe-8496-3d75e8db8c4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:11.680345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85d348-672e-48fe-8496-3d75e8db8c4f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:11.681911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 488/1005] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:11.687577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:11.696030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a3987-7c7f-4b73-af73-2fb3f21a8be4 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:11.700440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a1dd-c204-4fea-a57f-8bc41de77b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:11.701081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a1dd-c204-4fea-a57f-8bc41de77b1e admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:11.701362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a1dd-c204-4fea-a57f-8bc41de77b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:11.701632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a1dd-c204-4fea-a57f-8bc41de77b1e admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:11.702331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79a1dd-c204-4fea-a57f-8bc41de77b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:11.704178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79a1dd-c204-4fea-a57f-8bc41de77b1e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:11.791924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 518/1006] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:09:11 2021] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:09:13.951316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9857e-55d6-4169-b884-6d3ed97ddacb None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:13.951908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9857e-55d6-4169-b884-6d3ed97ddacb None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:13.951908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9857e-55d6-4169-b884-6d3ed97ddacb None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:13.953644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 489/1007] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:13.961371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:13.961817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:13.961919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:13.979845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:13.981034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:13.988538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 519/1008] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:14.013053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9857e-55d6-4169-b884-6d3ed97ddacb None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:14.025327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9857e-55d6-4169-b884-6d3ed97ddacb None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:14.029617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:14.030435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:14.030713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:14.030986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] PATH_INFO: `/v3/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:14.032411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] RBAC: Authorizing `identity:get_role(role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:14.033422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:09:14.033422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:09:14.033422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:09:14.034299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:14.035572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 490/1009] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:14 2021] GET /identity/v3/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:14.041995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:14.050428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65a4c-c3c7-47a8-b299-2b2cbead6ff6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:14.054841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:14.055669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:14.055952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:14.056227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] PATH_INFO: `/v3/users/f75e42666c5647d2b9264e3dd0aafbf1` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:14.069322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] RBAC: Authorizing `identity:get_user(user_id=f75e42666c5647d2b9264e3dd0aafbf1)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:14.071404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:14.073002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 520/1010] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:14 2021] GET /identity/v3/users/f75e42666c5647d2b9264e3dd0aafbf1 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:14.078758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:14.088350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cbcff-3cd2-4521-8be3-08fce92bc159 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:14.092849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:14.093467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:14.094667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:14.094667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:14.101800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:14.103742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:14.112206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 491/1011] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:14 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:14.118221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:14.127363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb590a15-82b2-4738-a67d-e9be4f770d8f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:14.132351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27dc0-ffe7-4ec7-9323-3faaf49bb709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:14.133193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27dc0-ffe7-4ec7-9323-3faaf49bb709 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:14.133479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27dc0-ffe7-4ec7-9323-3faaf49bb709 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:14.133757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27dc0-ffe7-4ec7-9323-3faaf49bb709 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:14.134923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27dc0-ffe7-4ec7-9323-3faaf49bb709 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:14.136936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27dc0-ffe7-4ec7-9323-3faaf49bb709 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:14.138534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 521/1012] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:14 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:14.144440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:14.153335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a05b-8fdf-4c5b-a9e2-1bfd4ba31fe8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:14.157811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:14.158410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:14.158695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:14.158969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:14.159764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] RBAC: Adding query filter params (role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=2fa0f9f83e164243a5099ad7faeebf70, user.id=f75e42666c5647d2b9264e3dd0aafbf1) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:14.160070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:14.161905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76a40-ce98-44cd-b94c-7c9cb99df235 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:14.166959 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 492/1013] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:14 2021] GET /identity/v3/role_assignments?user.id=f75e42666c5647d2b9264e3dd0aafbf1&scope.project.id=2fa0f9f83e164243a5099ad7faeebf70&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:16.256845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3474-b79f-4085-8b4e-fec1db0ebaf4 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:16.257305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3474-b79f-4085-8b4e-fec1db0ebaf4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:16.257395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3474-b79f-4085-8b4e-fec1db0ebaf4 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:16.259157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 522/1014] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:16.266322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:16.266748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:16.266913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:16.284691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:16.285869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:16.293549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 493/1015] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:16.317105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3474-b79f-4085-8b4e-fec1db0ebaf4 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:16.329347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3474-b79f-4085-8b4e-fec1db0ebaf4 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:16.333655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:16.334475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:16.334757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:16.335031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] PATH_INFO: `/v3/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:16.336497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] RBAC: Authorizing `identity:get_role(role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:16.337477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:09:16.337477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:09:16.337477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:09:16.338346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:16.339626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 523/1016] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:16 2021] GET /identity/v3/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:16.345534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:16.354919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2a423-3a47-4c56-81e7-a106dd2d2925 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:16.359354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:16.360191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:16.360509 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:16.360788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] PATH_INFO: `/v3/users/f75e42666c5647d2b9264e3dd0aafbf1` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:16.361953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] RBAC: Authorizing `identity:get_user(user_id=f75e42666c5647d2b9264e3dd0aafbf1)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:16.364688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:16.366228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 494/1017] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:16 2021] GET /identity/v3/users/f75e42666c5647d2b9264e3dd0aafbf1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:16.371899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:16.380926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9edac6-daaa-4aad-9594-714be6a726ce admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:16.385356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6643-b746-4540-a966-f8889448f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:16.386147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6643-b746-4540-a966-f8889448f293 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:16.386430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6643-b746-4540-a966-f8889448f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:16.386707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6643-b746-4540-a966-f8889448f293 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:16.387831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d6643-b746-4540-a966-f8889448f293 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:16.389839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d6643-b746-4540-a966-f8889448f293 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:16.391408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 524/1018] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:16 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:16.397257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:16.406401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae7933-8647-4cd5-b245-ad8679a9531e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:16.410869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30508a-3b36-4af5-83a5-b968cc4648f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:16.412187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30508a-3b36-4af5-83a5-b968cc4648f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:16.412498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30508a-3b36-4af5-83a5-b968cc4648f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:16.412776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30508a-3b36-4af5-83a5-b968cc4648f6 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70/users/f75e42666c5647d2b9264e3dd0aafbf1/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:16.414946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30508a-3b36-4af5-83a5-b968cc4648f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa0f9f83e164243a5099ad7faeebf70, user_id=f75e42666c5647d2b9264e3dd0aafbf1, role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:16.417533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30508a-3b36-4af5-83a5-b968cc4648f6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:16.505092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 495/1019] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:09:16 2021] PUT /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70/users/f75e42666c5647d2b9264e3dd0aafbf1/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:09:18.617567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d121-2917-469e-bb6e-2f6c4f8a6694 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.618116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d121-2917-469e-bb6e-2f6c4f8a6694 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.618116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d121-2917-469e-bb6e-2f6c4f8a6694 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.619896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 525/1020] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:18.627102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.627548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.627652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.644782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:18.645954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:18.700675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 496/1021] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:18.725237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d121-2917-469e-bb6e-2f6c4f8a6694 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:18.737379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d121-2917-469e-bb6e-2f6c4f8a6694 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:18.742365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:18.743201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.743489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.743772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] PATH_INFO: `/v3/roles/f456759a2a984f4aa3a2958c7ab8548f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.745281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] RBAC: Authorizing `identity:get_role(role_id=f456759a2a984f4aa3a2958c7ab8548f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:18.746851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:18.748155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 526/1022] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:18 2021] GET /identity/v3/roles/f456759a2a984f4aa3a2958c7ab8548f => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:18.754070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:18.762624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf527c1d-c043-4378-be80-a0985fc3325f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:18.767046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:18.767883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.768164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.768457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] PATH_INFO: `/v3/users/f75e42666c5647d2b9264e3dd0aafbf1` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.769627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] RBAC: Authorizing `identity:get_user(user_id=f75e42666c5647d2b9264e3dd0aafbf1)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:18.771741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:18.773317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 497/1023] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:18 2021] GET /identity/v3/users/f75e42666c5647d2b9264e3dd0aafbf1 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:18.779081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:18.788707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090348f-bfa7-454f-a112-03600cbe843d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:18.793117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:18.793718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.794002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.794275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.802285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:18.803933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:18.812330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 527/1024] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:09:18.818404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:18.827553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef36e-59ca-4376-a093-640fe60a7e07 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:18.832048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06403f6d-8423-482e-9c7a-21f7368d5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:18.832883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06403f6d-8423-482e-9c7a-21f7368d5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.833197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06403f6d-8423-482e-9c7a-21f7368d5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.833478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06403f6d-8423-482e-9c7a-21f7368d5ff5 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.834615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06403f6d-8423-482e-9c7a-21f7368d5ff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:18.836627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06403f6d-8423-482e-9c7a-21f7368d5ff5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:18.838219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 498/1025] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:18 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:18.844275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:18.854140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4a147-b0ef-4a04-a4f2-72c30d7b0bad admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:18.858640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:18.859262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:18.859543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:18.859818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:18.860660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] RBAC: Adding query filter params (role.id=f456759a2a984f4aa3a2958c7ab8548f, scope.project.id=2fa0f9f83e164243a5099ad7faeebf70, user.id=f75e42666c5647d2b9264e3dd0aafbf1) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:18.860974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:18.862766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395aa56-0dee-463d-8a75-5bf0e7a5e262 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:18.868893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 528/1026] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:18 2021] GET /identity/v3/role_assignments?user.id=f75e42666c5647d2b9264e3dd0aafbf1&scope.project.id=2fa0f9f83e164243a5099ad7faeebf70&role.id=f456759a2a984f4aa3a2958c7ab8548f => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:20.999392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d855b5-b30e-4113-832f-c159aaf593bb None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:20.999956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d855b5-b30e-4113-832f-c159aaf593bb None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:20.999956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d855b5-b30e-4113-832f-c159aaf593bb None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:21.001732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 499/1027] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:21.008921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:21.009347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:21.009477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:21.026403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:21.027574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:21.035023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 529/1028] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:21.060209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d855b5-b30e-4113-832f-c159aaf593bb None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:21.072482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d855b5-b30e-4113-832f-c159aaf593bb None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:21.076773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31c81e-277b-4069-80bf-660335a928c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:21.077528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31c81e-277b-4069-80bf-660335a928c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:21.077809 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31c81e-277b-4069-80bf-660335a928c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:21.078081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31c81e-277b-4069-80bf-660335a928c6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:21.079218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31c81e-277b-4069-80bf-660335a928c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:21.080906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31c81e-277b-4069-80bf-660335a928c6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:21.082426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 500/1029] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:21.088766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:21.097219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc9ae-8bc6-4c34-ad19-66d914fbe786 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:21.101706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9ac1-87a3-46a3-881a-b74553c6e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:21.102335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9ac1-87a3-46a3-881a-b74553c6e819 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:21.102617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9ac1-87a3-46a3-881a-b74553c6e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:21.102894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9ac1-87a3-46a3-881a-b74553c6e819 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:21.103847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9ac1-87a3-46a3-881a-b74553c6e819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:21.105887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9ac1-87a3-46a3-881a-b74553c6e819 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:21.220207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 530/1030] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:09:21 2021] POST /identity/v3/projects => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:09:23.402083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c74a-3a77-494e-8dbe-c13c114e9a05 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:23.402635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c74a-3a77-494e-8dbe-c13c114e9a05 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:23.402635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c74a-3a77-494e-8dbe-c13c114e9a05 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:23.404392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 501/1031] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:09:23.412172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:23.412616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:23.412770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:23.430432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:23.431593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:23.485706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 531/1032] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:09:23.510914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c74a-3a77-494e-8dbe-c13c114e9a05 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:23.523160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c74a-3a77-494e-8dbe-c13c114e9a05 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:23.527446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f1672-cc6f-45e0-8b89-782f89db8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:23.528212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f1672-cc6f-45e0-8b89-782f89db8d6e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:23.528524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f1672-cc6f-45e0-8b89-782f89db8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:23.528811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f1672-cc6f-45e0-8b89-782f89db8d6e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:23.529952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f1672-cc6f-45e0-8b89-782f89db8d6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:23.531610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f1672-cc6f-45e0-8b89-782f89db8d6e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:23.533177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 502/1033] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:09:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:23.539424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:23.547831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8d54-af84-46a8-9964-22682816801f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:23.552234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62cd51-860c-48ff-9b1d-d37ae2398585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:23.552911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62cd51-860c-48ff-9b1d-d37ae2398585 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:23.553194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62cd51-860c-48ff-9b1d-d37ae2398585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:23.553468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62cd51-860c-48ff-9b1d-d37ae2398585 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:23.554171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62cd51-860c-48ff-9b1d-d37ae2398585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:23.556032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62cd51-860c-48ff-9b1d-d37ae2398585 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:23.642088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 532/1034] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:09:23 2021] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:09:25.821068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac825b-4ae0-4cc9-8191-7ae66ddd1fd7 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:25.821598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac825b-4ae0-4cc9-8191-7ae66ddd1fd7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:25.821598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac825b-4ae0-4cc9-8191-7ae66ddd1fd7 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:25.823380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 503/1035] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:25.830482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:25.830886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:25.831048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:25.848056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:25.849261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:25.857083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 533/1036] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:25.882304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac825b-4ae0-4cc9-8191-7ae66ddd1fd7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:25.894199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac825b-4ae0-4cc9-8191-7ae66ddd1fd7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:25.898532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:25.899292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:25.899578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:25.899856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:25.909707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:25.916315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:25.917456 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 504/1037] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:25.923564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:25.932669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124f42-fff4-4d11-bdb8-b15b8a760367 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:25.937140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:25.937782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:25.938067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:25.938343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:25.939078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:25.939386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:25.940991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:25.949569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 534/1038] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:25.955790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:25.967034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468cb43-8a09-4085-a525-05adcaea7062 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:25.971461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:25.972293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:25.972608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:25.972887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] PATH_INFO: `/v3/users/d8a2cbb71af5415fbc0155ea80966290` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:25.986236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] RBAC: Authorizing `identity:get_user(user_id=d8a2cbb71af5415fbc0155ea80966290)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:25.988333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:25.989975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 505/1039] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:25 2021] GET /identity/v3/users/d8a2cbb71af5415fbc0155ea80966290 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:25.996298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:26.005698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce8bf-b867-4640-a54c-de6dec249ea0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:26.010156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:26.010785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:26.011074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:26.011354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:26.018822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:26.021062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:26.029578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 535/1040] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:25 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:26.036128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:26.045166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1aba-23e0-42ad-82a3-753ac5f3a5ad admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:26.049530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136f42b-ba2f-4a12-ac1c-3bc3e8300a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:26.050334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136f42b-ba2f-4a12-ac1c-3bc3e8300a38 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:26.050705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136f42b-ba2f-4a12-ac1c-3bc3e8300a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:26.050979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136f42b-ba2f-4a12-ac1c-3bc3e8300a38 admin admin] PATH_INFO: `/v3/projects/d3ada4becfc745a397563ae630275ae5` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:26.052101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136f42b-ba2f-4a12-ac1c-3bc3e8300a38 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3ada4becfc745a397563ae630275ae5)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:26.054092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136f42b-ba2f-4a12-ac1c-3bc3e8300a38 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:26.055662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 506/1041] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:26 2021] GET /identity/v3/projects/d3ada4becfc745a397563ae630275ae5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:26.061746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:26.070596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55015a-d620-4edd-9779-97296c544af5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:26.075149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:26.075717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:26.076009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:26.076293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:26.077152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d3ada4becfc745a397563ae630275ae5, user.id=d8a2cbb71af5415fbc0155ea80966290) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:26.077470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:26.079244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc71c-aa88-49db-a2d6-2992deadedcc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:26.084948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 536/1042] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:26 2021] GET /identity/v3/role_assignments?user.id=d8a2cbb71af5415fbc0155ea80966290&scope.project.id=d3ada4becfc745a397563ae630275ae5&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:28.191050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34497bc-39d6-4f3e-907f-3d542189f2ec None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.191644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34497bc-39d6-4f3e-907f-3d542189f2ec None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.191644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34497bc-39d6-4f3e-907f-3d542189f2ec None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.193437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 507/1043] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:28.200407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.200853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.200996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.218642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:28.219808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:28.227875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 537/1044] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:09:28.252503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34497bc-39d6-4f3e-907f-3d542189f2ec None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:28.264438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34497bc-39d6-4f3e-907f-3d542189f2ec None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:28.268756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:28.269530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.270329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.270606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.280367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:28.287637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:28.288786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 508/1045] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:28.295031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:28.303607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76da17-2950-4aa0-be36-2a7cf60388d7 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:28.308007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:28.308689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.308975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.309255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.309994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:28.310299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:28.311852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:28.320368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 538/1046] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:28.326278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:28.336534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e55f3-85cc-4302-bd7c-59ff92795be9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:28.340952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:28.341763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.342048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.342322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] PATH_INFO: `/v3/users/d8a2cbb71af5415fbc0155ea80966290` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.343479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] RBAC: Authorizing `identity:get_user(user_id=d8a2cbb71af5415fbc0155ea80966290)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:28.345605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:28.347145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 509/1047] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:28 2021] GET /identity/v3/users/d8a2cbb71af5415fbc0155ea80966290 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:28.352800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:28.361996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4183468-0ce2-44dc-af22-a49cf17ddec0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:28.366419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bbb7f-ee03-41db-a5ed-ea4642c87cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:28.367223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bbb7f-ee03-41db-a5ed-ea4642c87cbd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.367504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bbb7f-ee03-41db-a5ed-ea4642c87cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.367776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bbb7f-ee03-41db-a5ed-ea4642c87cbd admin admin] PATH_INFO: `/v3/projects/d3ada4becfc745a397563ae630275ae5` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.368933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bbb7f-ee03-41db-a5ed-ea4642c87cbd admin admin] RBAC: Authorizing `identity:get_project(project_id=d3ada4becfc745a397563ae630275ae5)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:28.370891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bbb7f-ee03-41db-a5ed-ea4642c87cbd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:28.372464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 539/1048] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:28 2021] GET /identity/v3/projects/d3ada4becfc745a397563ae630275ae5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:28.378338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:28.387830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1009e4-8f98-41ba-bbee-ebf6b3d2b93e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:28.392281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af453563-c0e1-4752-b68d-52d3a7df9f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:28.393132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453563-c0e1-4752-b68d-52d3a7df9f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:28.393417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453563-c0e1-4752-b68d-52d3a7df9f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:28.393695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453563-c0e1-4752-b68d-52d3a7df9f01 admin admin] PATH_INFO: `/v3/projects/d3ada4becfc745a397563ae630275ae5/users/d8a2cbb71af5415fbc0155ea80966290/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:28.396244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af453563-c0e1-4752-b68d-52d3a7df9f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ada4becfc745a397563ae630275ae5, user_id=d8a2cbb71af5415fbc0155ea80966290, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:28.398819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af453563-c0e1-4752-b68d-52d3a7df9f01 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:28.487614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 510/1049] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:09:28 2021] PUT /identity/v3/projects/d3ada4becfc745a397563ae630275ae5/users/d8a2cbb71af5415fbc0155ea80966290/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:09:30.640281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1eee-9ab1-4250-a99f-3f451c294452 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.640850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1eee-9ab1-4250-a99f-3f451c294452 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.640850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1eee-9ab1-4250-a99f-3f451c294452 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.642617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 540/1050] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:30.650646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.651023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.651212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.668294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:30.669498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:30.723539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 511/1051] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:30.748078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1eee-9ab1-4250-a99f-3f451c294452 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:30.760281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1eee-9ab1-4250-a99f-3f451c294452 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:30.764660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:30.765426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.765712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.765990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.776298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:30.782927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:30.784045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 541/1052] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:30.790199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:30.798741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8750-286d-4cd7-9d30-2f6b872a129c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:30.803204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:30.803841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.804125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.804398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.805161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:30.805467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:30.807032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:30.814934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 512/1053] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:30.821283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:30.830739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8be62-9997-4d7c-b4bc-dcda3c28f1a0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:30.835704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:30.836538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.836825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.837098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] PATH_INFO: `/v3/users/d8a2cbb71af5415fbc0155ea80966290` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.838255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8a2cbb71af5415fbc0155ea80966290)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:30.840461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:30.842109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 542/1054] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:30 2021] GET /identity/v3/users/d8a2cbb71af5415fbc0155ea80966290 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:30.847790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:30.857036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871884c-fc8e-4675-894c-28999c2426e5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:30.861536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:30.862133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.862418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.862696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.870122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:30.871786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:30.880859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 513/1055] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:30.886582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:30.896220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1e8be-b55a-4cd2-9cb6-838b280b7774 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:30.900775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0af4f0-4743-4a17-8156-c352588861b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:30.901994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0af4f0-4743-4a17-8156-c352588861b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.902482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0af4f0-4743-4a17-8156-c352588861b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.902999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0af4f0-4743-4a17-8156-c352588861b3 admin admin] PATH_INFO: `/v3/projects/d3ada4becfc745a397563ae630275ae5` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.904201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0af4f0-4743-4a17-8156-c352588861b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3ada4becfc745a397563ae630275ae5)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:30.906229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0af4f0-4743-4a17-8156-c352588861b3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:30.907848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 543/1056] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:30 2021] GET /identity/v3/projects/d3ada4becfc745a397563ae630275ae5 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:09:30.914205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:30.923021 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9533ddb-fff4-4b8f-a041-a8233c9b7099 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:30.928102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:30.928777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:30.929066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:30.929350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:30.930176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d3ada4becfc745a397563ae630275ae5, user.id=d8a2cbb71af5415fbc0155ea80966290) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:30.930492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:30.932293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccde22a-1582-403e-ab83-74118b72a411 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:30.938046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 514/1057] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:30 2021] GET /identity/v3/role_assignments?user.id=d8a2cbb71af5415fbc0155ea80966290&scope.project.id=d3ada4becfc745a397563ae630275ae5&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:33.074026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009a23-74be-45fd-a7d4-242b3f6d7367 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:33.074654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009a23-74be-45fd-a7d4-242b3f6d7367 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:33.074654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009a23-74be-45fd-a7d4-242b3f6d7367 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:33.076339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 544/1058] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:33.084151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:33.084540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:33.084736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:33.101838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:33.103008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:33.110798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 515/1059] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:33.134184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009a23-74be-45fd-a7d4-242b3f6d7367 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:33.146415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009a23-74be-45fd-a7d4-242b3f6d7367 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:33.150660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:33.151277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:33.151561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:33.151839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:33.159179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:33.160960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:33.169766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 545/1060] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:33 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:33.176305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:33.184768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9443b-f0be-4864-92e6-dc266cc41e27 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:33.189156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:33.189923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:33.190201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:33.190477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:33.197698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:33.199475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:33.213792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-0454bcdc-c993-4da8-9d73-e908b8472c6d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 22:09:33.214940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 516/1061] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:09:33 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:33.221441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:33.230479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10dea7-b8be-4999-946a-d8c6af4366a3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:33.235108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:33.235759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:33.236048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:33.236331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:33.237495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:33.237812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:33.239888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58530a5-4b63-4b3b-9627-399db63206dd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:33.247163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 546/1062] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 14 22:09:33 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:35.364044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184ca3b-cd80-4783-9d3f-04ce6680b2a7 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:35.364604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184ca3b-cd80-4783-9d3f-04ce6680b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:35.364604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184ca3b-cd80-4783-9d3f-04ce6680b2a7 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:35.366394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 517/1063] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:35.373431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5915-abe1-479e-a328-fb55684ad5a1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:35.373880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5915-abe1-479e-a328-fb55684ad5a1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:35.373975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5915-abe1-479e-a328-fb55684ad5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:35.391606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ad4b5915-abe1-479e-a328-fb55684ad5a1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:35.392814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ad4b5915-abe1-479e-a328-fb55684ad5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:35.400782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 547/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:35.425775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184ca3b-cd80-4783-9d3f-04ce6680b2a7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:35.437779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184ca3b-cd80-4783-9d3f-04ce6680b2a7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:35.442648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:35.443286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:35.443573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:35.443852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:35.444625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:35.445616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:09:35.445616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:09:35.445616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:09:35.446493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d1aa-8a2e-4196-a62e-c63cf08e557d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:35.528233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 518/1065] 10.222.0.20 () {60 vars in 1160 bytes} [Tue Sep 14 22:09:35 2021] POST /identity/v3/domains => generated 267 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:09:37.719615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3de66f-bc07-4b8a-bc7d-af0976e9d6cc None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:37.720145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3de66f-bc07-4b8a-bc7d-af0976e9d6cc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:37.720259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3de66f-bc07-4b8a-bc7d-af0976e9d6cc None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:37.721977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 548/1066] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:37.729654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:37.730045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:37.730213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:37.748046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:37.749291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:37.803477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 519/1067] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:09:37.827664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3de66f-bc07-4b8a-bc7d-af0976e9d6cc None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:37.840251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3de66f-bc07-4b8a-bc7d-af0976e9d6cc None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:37.844677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e445f0c-8b9d-4af8-8fa0-66727d48b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:37.845521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e445f0c-8b9d-4af8-8fa0-66727d48b315 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:37.845811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e445f0c-8b9d-4af8-8fa0-66727d48b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:37.846093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e445f0c-8b9d-4af8-8fa0-66727d48b315 admin admin] PATH_INFO: `/v3/domains/daec7dec7e5545d7853b0f4daf98f271` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:37.857178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e445f0c-8b9d-4af8-8fa0-66727d48b315 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=daec7dec7e5545d7853b0f4daf98f271)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:37.859138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e445f0c-8b9d-4af8-8fa0-66727d48b315 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:37.860904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 549/1068] 10.222.0.20 () {56 vars in 1205 bytes} [Tue Sep 14 22:09:37 2021] GET /identity/v3/domains/daec7dec7e5545d7853b0f4daf98f271 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:37.869217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:37.878066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59210f98-6903-4d07-aead-14cddcc15a21 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:37.882594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b94f-2e84-447a-b6d8-86b656a4744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:37.883244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b94f-2e84-447a-b6d8-86b656a4744f admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:37.883528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b94f-2e84-447a-b6d8-86b656a4744f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:37.883804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b94f-2e84-447a-b6d8-86b656a4744f admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:37.884549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593b94f-2e84-447a-b6d8-86b656a4744f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:37.886444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593b94f-2e84-447a-b6d8-86b656a4744f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:37.968096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 520/1069] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:09:37 2021] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:09:40.110055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea4455-cbf0-4df1-a96b-4f43f22836bd None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:40.110580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea4455-cbf0-4df1-a96b-4f43f22836bd None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:40.110580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea4455-cbf0-4df1-a96b-4f43f22836bd None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:40.112349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 550/1070] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:40.119848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:40.120229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:40.120409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:40.137623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:40.138807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:40.194282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 521/1071] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:40.219667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea4455-cbf0-4df1-a96b-4f43f22836bd None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:40.232224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea4455-cbf0-4df1-a96b-4f43f22836bd None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:40.236641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39386e-d677-494c-aa75-7f6909bebab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:40.237496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39386e-d677-494c-aa75-7f6909bebab2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:40.238326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39386e-d677-494c-aa75-7f6909bebab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:40.238606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39386e-d677-494c-aa75-7f6909bebab2 admin admin] PATH_INFO: `/v3/domains/daec7dec7e5545d7853b0f4daf98f271` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:40.239814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39386e-d677-494c-aa75-7f6909bebab2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=daec7dec7e5545d7853b0f4daf98f271)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:40.241788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39386e-d677-494c-aa75-7f6909bebab2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:40.243351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 551/1072] 10.222.0.20 () {56 vars in 1205 bytes} [Tue Sep 14 22:09:40 2021] GET /identity/v3/domains/daec7dec7e5545d7853b0f4daf98f271 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:40.249516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:40.258226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714baaa-6a96-47f9-b7a6-dfe9f2a2b375 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:40.262684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59707-5afc-4f63-837a-40454b70c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:40.263337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59707-5afc-4f63-837a-40454b70c3fe admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:40.263619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59707-5afc-4f63-837a-40454b70c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:40.263894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59707-5afc-4f63-837a-40454b70c3fe admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:40.264628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e59707-5afc-4f63-837a-40454b70c3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:40.266488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e59707-5afc-4f63-837a-40454b70c3fe admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:40.344319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 522/1073] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:09:40 2021] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:09:42.525013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672ccf-a5b5-4baa-89c4-1421d5d4daa9 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.525513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672ccf-a5b5-4baa-89c4-1421d5d4daa9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.525513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672ccf-a5b5-4baa-89c4-1421d5d4daa9 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.527260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 552/1074] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:42.534245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.534689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.534828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.552018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:42.553234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:42.560773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 523/1075] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:09:42.585790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02672ccf-a5b5-4baa-89c4-1421d5d4daa9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:42.597528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02672ccf-a5b5-4baa-89c4-1421d5d4daa9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:42.601793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:42.602555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.602841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.603118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.613966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:42.620607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:42.621714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 553/1076] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:42.627713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:42.636938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d2be2-90ec-4efc-97ba-c3d1467c0847 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:42.641396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:42.642031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.642313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.642591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.643324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:42.643631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:42.645241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:42.653182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 524/1077] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:42.658892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:42.667847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701403b-c9d4-4d46-b0ba-a1f2a8426781 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:42.672493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:42.673316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.673625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.674005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] PATH_INFO: `/v3/users/11f83508335c473fad195a694c609a23` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.687554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] RBAC: Authorizing `identity:get_user(user_id=11f83508335c473fad195a694c609a23)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:42.689698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:42.691918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 554/1078] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:42 2021] GET /identity/v3/users/11f83508335c473fad195a694c609a23 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:42.698071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:42.707372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64272-215a-46ad-a89e-165b853f9f32 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:42.711873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:42.712534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.712820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.713093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.720591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:42.722290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:42.731089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 525/1079] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:42 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:09:42.736902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:42.746326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cf58a-5f2a-4fad-9b4d-d4f7655da991 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:42.750716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19811cf2-fa92-4737-8e31-3d2b0fbe674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:42.751521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811cf2-fa92-4737-8e31-3d2b0fbe674c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.751802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811cf2-fa92-4737-8e31-3d2b0fbe674c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.752079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811cf2-fa92-4737-8e31-3d2b0fbe674c admin admin] PATH_INFO: `/v3/projects/e8367ff1a1294a3e98c7515a9407948d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.753862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19811cf2-fa92-4737-8e31-3d2b0fbe674c admin admin] RBAC: Authorizing `identity:get_project(project_id=e8367ff1a1294a3e98c7515a9407948d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:42.755815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19811cf2-fa92-4737-8e31-3d2b0fbe674c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:42.757429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 555/1080] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:42 2021] GET /identity/v3/projects/e8367ff1a1294a3e98c7515a9407948d => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:42.763594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:42.771958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27c48a-b2ce-4fe8-90c9-fc0f67cd8827 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:42.776542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:42.777103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:42.777390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:42.777673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:42.778478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=e8367ff1a1294a3e98c7515a9407948d, user.id=11f83508335c473fad195a694c609a23) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:42.778795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:42.780600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5880f-a04e-4884-a08e-88ec904c4de6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:42.785718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 526/1081] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:42 2021] GET /identity/v3/role_assignments?user.id=11f83508335c473fad195a694c609a23&scope.project.id=e8367ff1a1294a3e98c7515a9407948d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:44.883593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12cfa5-16bb-4c9e-8b29-b75f0118243e None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:44.884186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12cfa5-16bb-4c9e-8b29-b75f0118243e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:44.884186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12cfa5-16bb-4c9e-8b29-b75f0118243e None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:44.885930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 556/1082] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:44.892786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:44.893208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:44.893352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:44.911652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:44.912892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:44.920477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 527/1083] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:44.943875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12cfa5-16bb-4c9e-8b29-b75f0118243e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:44.955556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12cfa5-16bb-4c9e-8b29-b75f0118243e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:44.960344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:44.961128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:44.961414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:44.961689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:44.971322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:44.978806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:44.979907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 557/1084] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:44.986074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:44.994665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1813a9-e533-4857-b85c-bf2951f541cf None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:44.999168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:44.999811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:45.000097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:45.000378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:45.001150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:45.001458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:45.003089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:45.011053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 528/1085] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:45.016966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:45.027813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f980949-0a35-43ba-9ae7-3a416020f3a1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:45.032245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:45.033089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:45.033373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:45.033648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] PATH_INFO: `/v3/users/11f83508335c473fad195a694c609a23` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:45.035393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] RBAC: Authorizing `identity:get_user(user_id=11f83508335c473fad195a694c609a23)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:45.037486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:45.038997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 558/1086] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:45 2021] GET /identity/v3/users/11f83508335c473fad195a694c609a23 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:45.044757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:45.053847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a51a4-ba35-4202-a43f-8f826c7a33ac admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:45.058329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75964-1ed3-412d-ac3b-e2ec1faa4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:45.059140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75964-1ed3-412d-ac3b-e2ec1faa4cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:45.059435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75964-1ed3-412d-ac3b-e2ec1faa4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:45.059718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75964-1ed3-412d-ac3b-e2ec1faa4cd2 admin admin] PATH_INFO: `/v3/projects/e8367ff1a1294a3e98c7515a9407948d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:45.060896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75964-1ed3-412d-ac3b-e2ec1faa4cd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8367ff1a1294a3e98c7515a9407948d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:45.062874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75964-1ed3-412d-ac3b-e2ec1faa4cd2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:45.064480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 529/1087] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:45 2021] GET /identity/v3/projects/e8367ff1a1294a3e98c7515a9407948d => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:45.070213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:45.078997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c09e88-38bd-4095-8f12-f73b235d6579 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:45.083887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b35cc-1d65-4f35-a7b2-387c5b183841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:45.084724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b35cc-1d65-4f35-a7b2-387c5b183841 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:45.085006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b35cc-1d65-4f35-a7b2-387c5b183841 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:45.085337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b35cc-1d65-4f35-a7b2-387c5b183841 admin admin] PATH_INFO: `/v3/projects/e8367ff1a1294a3e98c7515a9407948d/users/11f83508335c473fad195a694c609a23/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:45.087211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b35cc-1d65-4f35-a7b2-387c5b183841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8367ff1a1294a3e98c7515a9407948d, user_id=11f83508335c473fad195a694c609a23, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:45.089800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b35cc-1d65-4f35-a7b2-387c5b183841 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:45.198090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 559/1088] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:09:45 2021] PUT /identity/v3/projects/e8367ff1a1294a3e98c7515a9407948d/users/11f83508335c473fad195a694c609a23/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:09:47.325277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86939ce7-4201-427d-ade0-c6d27a743a48 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.325820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86939ce7-4201-427d-ade0-c6d27a743a48 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.325820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86939ce7-4201-427d-ade0-c6d27a743a48 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.327589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 530/1089] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:09:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:09:47.335192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.335592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.335754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.353638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:09:47.354819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:09:47.408116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 560/1090] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:09:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:09:47.433294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86939ce7-4201-427d-ade0-c6d27a743a48 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:47.445709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86939ce7-4201-427d-ade0-c6d27a743a48 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:47.450003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:47.450764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.451049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.451323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.461769 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:09:47.468362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:09:47.469507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 531/1091] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:09:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:09:47.476034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:47.484942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33d7b-4f4b-4c67-9e73-bdf0d3245b1b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:47.489505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:47.490097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.490382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.490657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.491395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:47.491702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:47.493296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:47.501180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 561/1092] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:09:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:47.507616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:47.517261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380908e-6555-4bd0-89b8-431ef3137c74 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:47.522256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:47.523072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.523354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.523628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] PATH_INFO: `/v3/users/11f83508335c473fad195a694c609a23` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.524792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] RBAC: Authorizing `identity:get_user(user_id=11f83508335c473fad195a694c609a23)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:47.526857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:47.528379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 532/1093] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:09:47 2021] GET /identity/v3/users/11f83508335c473fad195a694c609a23 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:47.534232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:47.543245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6ad8e-2226-40c5-9b69-368598276244 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:47.547626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:47.548233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.548556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.548835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.556207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:47.557914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:47.566833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 562/1094] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:09:47 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:09:47.572642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:47.582144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ce4fb-0f45-4244-87ed-b1352344be1b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:47.586542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411ce8b-6600-48e6-9f72-e54362836671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:47.587315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411ce8b-6600-48e6-9f72-e54362836671 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.587597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411ce8b-6600-48e6-9f72-e54362836671 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.587871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411ce8b-6600-48e6-9f72-e54362836671 admin admin] PATH_INFO: `/v3/projects/e8367ff1a1294a3e98c7515a9407948d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.589023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411ce8b-6600-48e6-9f72-e54362836671 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8367ff1a1294a3e98c7515a9407948d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:47.591057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411ce8b-6600-48e6-9f72-e54362836671 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:47.592679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 533/1095] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:09:47 2021] GET /identity/v3/projects/e8367ff1a1294a3e98c7515a9407948d => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:09:47.598623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:09:47.607212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303d27-7322-47a2-9933-2985e4b3c384 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:09:47.611594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:09:47.612188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:09:47.612504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:09:47.612785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:09:47.613622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=e8367ff1a1294a3e98c7515a9407948d, user.id=11f83508335c473fad195a694c609a23) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:09:47.613929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:09:47.615704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a346f-037f-4ba4-a7ab-e5c6b11e3925 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:09:47.621157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 563/1096] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:09:47 2021] GET /identity/v3/role_assignments?user.id=11f83508335c473fad195a694c609a23&scope.project.id=e8367ff1a1294a3e98c7515a9407948d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:00.187649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059a4ed-ec32-4d00-b743-eaccaf0d91a4 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:00.188255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059a4ed-ec32-4d00-b743-eaccaf0d91a4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:00.188255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059a4ed-ec32-4d00-b743-eaccaf0d91a4 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:00.190075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 534/1097] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:00.197875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:00.198314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:00.198440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:00.215582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:00.216814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:00.224437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 564/1098] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:00.250410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059a4ed-ec32-4d00-b743-eaccaf0d91a4 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:00.263360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059a4ed-ec32-4d00-b743-eaccaf0d91a4 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:00.267720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:00.268528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:00.268836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:00.269117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:00.279054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:00.280918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:00.296881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:00.298011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 535/1099] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:00.304952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:00.313759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bbeff-3a76-4b67-b0a4-150f4c0983e2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:00.318803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:00.319445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:00.319837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:00.320116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:00.320882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:00.321187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:00.322739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec804b-34b1-4902-990b-bdf4e8d72f7a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:00.333899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 565/1100] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:00.348229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:00.349257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09196f-2283-4f2e-bf46-2cf8282f33e7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:00.353984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21734007-e9b3-46d6-a341-a1c92ff348b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:00.354649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21734007-e9b3-46d6-a341-a1c92ff348b4 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:00.354932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21734007-e9b3-46d6-a341-a1c92ff348b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:00.355209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21734007-e9b3-46d6-a341-a1c92ff348b4 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:00.355944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21734007-e9b3-46d6-a341-a1c92ff348b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:00.357909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21734007-e9b3-46d6-a341-a1c92ff348b4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:00.519037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 536/1101] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Sep 14 22:11:00 2021] POST /identity/v3/users => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:11:02.706429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b3d3-c4fc-419c-998c-91abacc873bf None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.707066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b3d3-c4fc-419c-998c-91abacc873bf None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.707066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647b3d3-c4fc-419c-998c-91abacc873bf None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.708809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 566/1102] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:02.716097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.716572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.716666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.734743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:02.735917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:02.744044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 537/1103] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:02.768290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647b3d3-c4fc-419c-998c-91abacc873bf None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:02.780320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647b3d3-c4fc-419c-998c-91abacc873bf None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:02.784731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:02.786024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.786305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.786580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.797159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:11:02.804677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:11:02.805825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 567/1104] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:11:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:11:02.811951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:02.820779 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0d703-467a-423c-8666-ca2e968e1f19 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:02.825244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:02.825887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.826166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.826439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.827177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:02.827479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:02.829159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:02.837110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 538/1105] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:11:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:02.842986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:02.853037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314779f0-9aa8-4525-a0c8-ea602e351920 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:02.857694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:02.858664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.858948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.859225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.869722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:02.871520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:02.887643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:02.888809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 568/1106] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:02.895001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:02.904736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ef9e-dc30-47ce-946f-9917d17fa9d6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:02.909201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:02.909834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.910115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.910386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.911580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:02.911882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:02.913454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:02.924761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 539/1107] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:02.931254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:02.940671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94ce26-70f7-4fdb-acbf-fe9d2de9ed8a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:02.945992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:02.946419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.946706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.946983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.953952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:02.955929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:02.974680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 22:11:02.974680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 569/1108] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:02 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:02.979445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:02.989157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3061bc-588c-4051-9fd4-e205ddd94a61 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:02.993774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:02.994428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:02.994714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:02.994991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:02.995810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:02.996119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:02.997983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.015203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 540/1109] 10.222.0.20 () {56 vars in 1165 bytes} [Tue Sep 14 22:11:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:03.021998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:03.031533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c4b1-c55a-41b5-bd6a-aa33c3404de9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:03.036113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:03.036781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:03.037072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:03.037354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:03.044891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:03.046619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.055276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 570/1110] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:11:03 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:11:03.061409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:03.071378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51d22c-6d14-4916-82ee-147b6947855b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:03.075877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:03.076684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:03.076971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:03.077247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:03.088070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:03.089937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.106328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:03.107640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 541/1111] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:03.114136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:03.122827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56ea7d-ea7c-4508-a862-15a80788dd7f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:03.127491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:03.128136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:03.128434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:03.128723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:03.129962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:03.130273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:03.131845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.142834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 571/1112] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:03.148685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:03.158617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30df99-d348-46c8-ae84-69dfe0a1cd55 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:03.163061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:03.163825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:03.164105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:03.164378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:03.170966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:03.172970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.185709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:11:03.186811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 542/1113] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:11:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:03.193912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:03.203281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99a50-773a-4c78-b8e9-05801ac29453 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:03.208311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:03.209034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:03.209314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:03.209589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:03.210364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:03.210676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:03.212508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb972-c98f-48a9-9f75-4209d962d0ad admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.226711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 572/1114] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:11:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:03.231780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:03.242150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e23189-b711-4533-a2ba-542a42638ee6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:03.246780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:03.249773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:03.249773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:03.249773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:03.249773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=5270a4882c43439489e806c1c15a2e86) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:03.249773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:03.250931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba226fc0-e4bf-4585-94f9-4d692aa99373 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:03.256585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 543/1115] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:11:03 2021] GET /identity/v3/role_assignments?user.id=5270a4882c43439489e806c1c15a2e86&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:05.357215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1752c7-c69f-4e96-a571-8529e75ce8de None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.357738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1752c7-c69f-4e96-a571-8529e75ce8de None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.357848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1752c7-c69f-4e96-a571-8529e75ce8de None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.359533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 573/1116] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:05.366929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.367341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.367581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.385438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:05.386702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:05.394308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 544/1117] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:05.418625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1752c7-c69f-4e96-a571-8529e75ce8de None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.431317 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1752c7-c69f-4e96-a571-8529e75ce8de None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.435667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.436470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.436765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.437143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.447949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:11:05.454725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:11:05.455861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 574/1118] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:05.462194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.470918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235603b-a0e6-4378-a25e-00bd39252a67 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.475622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.476276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.476602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.476910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.477878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:05.478186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.479754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.487854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 545/1119] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:05.494758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.505467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9a10d-6280-4418-9db6-6dfceaab546a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.509885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.510639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.510919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.511190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.521193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.522987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.538616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:05.539739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 575/1120] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:05.545905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.555864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e764073-193a-46f4-ad89-44793a2daa7b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.560402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.561084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.561366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.561639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.562353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:05.562662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.564233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.576163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 546/1121] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:05.582433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.591912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2cfe7-819b-4861-a19d-9d077074618c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.596347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.597154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.597436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.597709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.605024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.607039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.621053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 22:11:05.622241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 576/1122] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:11:05.628244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.638088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ba88-081b-4e7f-9f4a-5c89020d5817 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.642581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.643223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.643504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.643778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.644634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:05.644942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.646758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.664137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 547/1123] 10.222.0.20 () {56 vars in 1165 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:05.670129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.679995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa79a3-f9a0-42c0-8e16-2433f8599c73 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.684491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.685252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.685534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.685810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.696387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.698287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.714607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:05.715715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 577/1124] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:11:05.721705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.731755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f4f1b-c442-46c6-b021-d362ac2bbd48 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.736199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.736860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.737144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.737421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.738170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:05.739048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.740686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.752011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 548/1125] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:05.757964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.767472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b018df-7c8d-411b-b8bb-b05034d27dc6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.771923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.772744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.773026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.773300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.779882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.781886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.794869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:11:05.796000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 578/1126] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:05.802813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.812171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599a0a-54a0-49c1-a503-0a6e84749237 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.816676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.817315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.817598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.817871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.818638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:05.818947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.820785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226989a-40b3-4875-9bda-564e5e5f435d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.832544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 549/1127] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:11:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:05.838754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:05.850559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae8c71-439a-4041-97df-415eef24ac4c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:05.855429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e0d6d-5a64-4615-a5a3-5d881b58f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:05.856279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e0d6d-5a64-4615-a5a3-5d881b58f476 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:05.856607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e0d6d-5a64-4615-a5a3-5d881b58f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:05.856884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e0d6d-5a64-4615-a5a3-5d881b58f476 admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/5270a4882c43439489e806c1c15a2e86/roles/81bfff1c4c9b4f40a5cc2c360790ba82` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:05.871059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e0d6d-5a64-4615-a5a3-5d881b58f476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=5270a4882c43439489e806c1c15a2e86, role_id=81bfff1c4c9b4f40a5cc2c360790ba82)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:05.873730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e0d6d-5a64-4615-a5a3-5d881b58f476 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:05.934990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 579/1128] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:11:05 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/5270a4882c43439489e806c1c15a2e86/roles/81bfff1c4c9b4f40a5cc2c360790ba82 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:11:08.076249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6df8a-52a1-4978-97c4-f49c1d18ab2c None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.076810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6df8a-52a1-4978-97c4-f49c1d18ab2c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.076923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6df8a-52a1-4978-97c4-f49c1d18ab2c None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.078667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 550/1129] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:08.086037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.086473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.086602 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.104424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:08.105613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:08.161200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 580/1130] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:11:08.186430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6df8a-52a1-4978-97c4-f49c1d18ab2c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.198478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6df8a-52a1-4978-97c4-f49c1d18ab2c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.202854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.212920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.212920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.212920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.214172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:11:08.220858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 22:11:08.221972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 551/1131] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:08.229112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.238027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9521d-3626-4b4d-bd3e-d2c565ab8cb0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.243409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.244062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.244343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.244646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.245385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:08.245689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.247286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.255236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 581/1132] 10.222.0.20 () {56 vars in 1125 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:08.261451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.271359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad487-6a96-4911-8f80-b371acd32642 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.275864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.276689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.276970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.277243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.287662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.292096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.306613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:08.307742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 552/1133] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:08.313894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.323327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d90e-710b-48cc-ba8f-61a8dd4b2815 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.327930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.328546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.328833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.329113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.329818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:08.330125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.331671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.343880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 582/1134] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:11:08.350725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.360278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c2b5-c055-4f30-ad9b-981f70cb63bf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.365028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.365819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.366217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.366540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.373815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.375832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.389732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 22:11:08.390859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 553/1135] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:08.397615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.407350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b186-d125-4b31-ac46-25b5637dbcc1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.412630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.413289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.413579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.413860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.414801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:08.415110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.416975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.433702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 583/1136] 10.222.0.20 () {56 vars in 1165 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:08.439751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.449255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de79775-35fb-4ead-9b91-0f6a247a560a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.453776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.454400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.454686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.454962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.463100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.464906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.474085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 554/1137] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:11:08.480430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.489872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ae2f-3ff9-4822-819b-7296b01af64b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.494404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.495168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.495451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.495727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.505829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.507633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.524367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:08.525535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 584/1138] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:08.531766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.541513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d439-837e-4fce-b2af-00d6ca61c5bd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.546125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.547849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.548143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.548444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.549173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:08.549482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.551046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.562328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 555/1139] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:08.568451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.577990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0939-0276-49b1-9b29-8f57966b8007 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.582953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.583713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.583996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.584273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.590914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.592866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.606126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:11:08.607233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 585/1140] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:11:08.613450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.623019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ad313-13b1-4e11-9340-7b233e00f40e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.627552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.631366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.631366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.631366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.631366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:08.631366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.631793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e0ac-5443-4157-8291-6d9d77b78382 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.643433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 556/1141] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:08.650392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:08.664227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018908-71ed-424e-a09f-3f583b2d55c0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:08.670636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:08.671270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:08.671553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:08.671828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:08.672739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] RBAC: Adding query filter params (role.id=81bfff1c4c9b4f40a5cc2c360790ba82, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=5270a4882c43439489e806c1c15a2e86) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:08.673053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:08.675477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d57174-597c-4f4d-82eb-c36c182b019f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:08.682919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 586/1142] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:11:08 2021] GET /identity/v3/role_assignments?user.id=5270a4882c43439489e806c1c15a2e86&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=81bfff1c4c9b4f40a5cc2c360790ba82 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:10.991893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c83c-2688-438f-a5cd-4f1b47118bf1 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:10.992471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c83c-2688-438f-a5cd-4f1b47118bf1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:10.992471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c83c-2688-438f-a5cd-4f1b47118bf1 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:10.994341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 557/1143] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:11.001346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.001785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.001879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.019280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:11.021085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:11.028594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 587/1144] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:11:11.053010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c83c-2688-438f-a5cd-4f1b47118bf1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.065000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c83c-2688-438f-a5cd-4f1b47118bf1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.070104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.070889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.071174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.071449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.081419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:11:11.088640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:11:11.089782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 558/1145] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:11.096243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.105262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9873-ad82-4d98-9110-7864aa0fd288 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.109764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.110523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.114058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.114058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.114058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:11.114058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.114058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.121665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 588/1146] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:11.127500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.137878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001aa560-6ba4-47f0-abb8-c6f34305e67c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.142319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.143067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.143350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.143626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.154045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.155891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.171836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:11.172971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 559/1147] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:11.179081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.188674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb349f-421a-4657-8f4f-b11d95931048 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.194006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.194653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.194938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.195266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.196020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:11.196324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.198076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.210626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 589/1148] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:11:11.216990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.226445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd9f05-04d7-4b25-9c9f-a2d2cb974a50 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.231239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.232014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.232298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.232627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.239777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.241813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.259298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 22:11:11.259298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 560/1149] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:11.263506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.273946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc496ab7-6d64-4634-bf95-6d1eacd4ee9f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.278444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.279089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.279371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.279647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.280494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:11.280805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.282603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.299342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 590/1150] 10.222.0.20 () {56 vars in 1165 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:11:11.305411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.314827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32084a-84c8-4437-9b93-7a1d24b1a32c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.320183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.320847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.321131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.321410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.329060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.330770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.340258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 561/1151] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:11:11.346391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.356003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e9332-bad5-4380-9abc-2a813f949a45 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.361010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.361823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.362104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.362381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.373349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.375148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.392061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:11.393803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 591/1152] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:11.399472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.408531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93dcc-bd38-454e-a547-24a26c005190 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.413219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.413842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.414126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.414402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.415112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:11.415418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.417091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.428802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 562/1153] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:11:11.434647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.444778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69c972-1cc9-4d61-95e0-e5e21af024c8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.449460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.450229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.450514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.450790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.457372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.459386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.472053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:11:11.474214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 592/1154] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:11.479471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.489626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bef9-594d-4d46-8c3c-4060d2032979 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.494211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.497190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.497190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.497190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.497190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:11.497190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.498285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965e10-61b7-46ef-812b-5317bd77ef87 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.510797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 563/1155] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:11.517305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:11.527385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d98bb-906e-47d8-843a-e23ddb1ab674 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:11.531885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:11.532548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:11.532831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:11.533104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:11.533912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=5270a4882c43439489e806c1c15a2e86) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:11.534222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:11.536009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275853-e927-4b7b-ac46-c4d0f28acd10 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:11.542608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 593/1156] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:11:11 2021] GET /identity/v3/role_assignments?user.id=5270a4882c43439489e806c1c15a2e86&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:13.649027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df33a47-84d6-4336-8ab8-8fc9da258db1 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.649582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df33a47-84d6-4336-8ab8-8fc9da258db1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.649582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df33a47-84d6-4336-8ab8-8fc9da258db1 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.651377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 564/1157] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:13.658304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.658727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.658865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.676379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:13.677586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:13.685267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 594/1158] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:13.709268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df33a47-84d6-4336-8ab8-8fc9da258db1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.721164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df33a47-84d6-4336-8ab8-8fc9da258db1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.726140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.726989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.727523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.727800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.737748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:11:13.744337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:11:13.745501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 565/1159] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:13.751836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.760588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8d814-3729-43d4-bad8-6d1feea81d48 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.765063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.765723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.766011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.766291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.767034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:13.767344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:13.768946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:13.777588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 595/1160] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:13.783710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.794307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a928-38b8-476a-89a1-0e2b8a6db126 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.798951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.801672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.801672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.801672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.810278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:13.812098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:13.828103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:13.829232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 566/1161] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 22:11:13.835590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.844853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cb07-64ec-45a7-8df0-f8ec04394046 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.850034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.850673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.850959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.851239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.851944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:13.852544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:13.854103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:13.865385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 596/1162] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:13.871398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.880765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cab78-46ca-4c5b-9699-93a86a52e35f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.885249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.886013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.886298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.886570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.893748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:13.896225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:13.911494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 22:11:13.912666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 567/1163] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:13.918842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.928364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b074c-384d-4adb-b1e7-a3dbfc387637 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.932901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.933548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.933854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.934109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.934929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:13.935235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:13.937067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:13.954689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 597/1164] 10.222.0.20 () {56 vars in 1165 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:13.961254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:13.970882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571378b-d57d-442b-b9ce-6937eac1c1b9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:13.975476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:13.976243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:13.976554 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:13.976827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:13.987328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:13.989281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:14.005961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:14.007049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 568/1165] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:14.013085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:14.022933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b144c1-5d75-457e-804d-995e6a7cfef4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:14.027683 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:14.028330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:14.028652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:14.028975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:14.029682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:14.029990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:14.031546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:14.042480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 598/1166] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:14.048310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:14.057606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf4eb-607f-4405-a9e4-38777938ed32 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:14.062113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:14.062872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:14.063154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:14.063477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:14.070544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:14.072482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:14.085722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:11:14.087067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 569/1167] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:11:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:14.093082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:14.102910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ab7d5-cb36-47cd-89ef-ce37bf6bee10 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:14.107671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:14.108319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:14.108647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:14.108930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:14.109710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:14.110025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:14.111897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8fd5-f8ff-4579-8007-42ef82326413 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:14.123624 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 599/1168] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:11:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:14.130352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:14.140413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bfc31-c445-440c-9726-28d5080cd839 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:14.145461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e4665-78aa-484e-9372-8f36c995fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:14.146313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4665-78aa-484e-9372-8f36c995fe7d admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:14.146593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4665-78aa-484e-9372-8f36c995fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:14.146884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4665-78aa-484e-9372-8f36c995fe7d admin admin] PATH_INFO: `/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/5270a4882c43439489e806c1c15a2e86/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:14.148852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e4665-78aa-484e-9372-8f36c995fe7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23bf3fa5aa24998a1474108d98fd29d, user_id=5270a4882c43439489e806c1c15a2e86, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:14.151430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e4665-78aa-484e-9372-8f36c995fe7d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:14.267028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 570/1169] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 14 22:11:14 2021] PUT /identity/v3/projects/d23bf3fa5aa24998a1474108d98fd29d/users/5270a4882c43439489e806c1c15a2e86/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:11:16.373726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab012-6c3c-4fd5-bb97-607d975be695 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.374364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab012-6c3c-4fd5-bb97-607d975be695 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.374364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab012-6c3c-4fd5-bb97-607d975be695 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.376049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 600/1170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:16.383680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.391533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.391533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.401956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:16.403115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:16.460326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 571/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:16.485029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab012-6c3c-4fd5-bb97-607d975be695 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.497038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab012-6c3c-4fd5-bb97-607d975be695 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.501346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.502113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.502399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.502676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.513073 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 22:11:16.520327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 22:11:16.521482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 601/1172] 10.222.0.20 () {56 vars in 1118 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:16.527951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.536666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a33c7-201d-4428-a9ef-3007b662a651 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.541199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.541843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.542122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.542392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.543120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:16.543420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.545020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.553064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 572/1173] 10.222.0.20 () {56 vars in 1121 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:16.559003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.569294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992349ab-d6d0-4866-92b8-d429bd8b37d8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.573758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.574511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.574794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.575071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.585537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.587335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.604067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:16.605250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 602/1174] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:16.611581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.621406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bd678-a78a-4beb-a03d-c70f809c9daf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.625886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.626525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.626807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.627081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.627787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:16.628091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.630322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.641628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 573/1175] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:16.647804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.657295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f94d6-6271-4d05-b0c3-39174a6dc8fa admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.661823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.662601 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.662885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.663160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.670179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.672157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.686174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 22:11:16.687279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 603/1176] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:16.694075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.703748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3828-6758-434b-bc26-22bfd69b7f4f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.708276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.708960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.709248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.709527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.710357 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:16.710667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.712506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.729329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 574/1177] 10.222.0.20 () {56 vars in 1165 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:16.735615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.745496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d689-25cf-4d5b-9213-ee6412f084fa admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.749981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.750552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.750834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.751105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.759109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.760854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.769266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 604/1178] 10.222.0.20 () {58 vars in 1325 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:11:16.775168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.784401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205a2c8-1d21-44dd-b0ec-d41fe2d8b4a4 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.789007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.789853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.792159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.792159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.800822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.802621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.819104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 22:11:16.820840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 575/1179] 10.222.0.20 () {56 vars in 1130 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:16.826211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.834739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b73bf3-5ae9-4e35-89e4-ec7015d0b68e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.839353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.839993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.840279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.840599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.841309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:16.841615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.843161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.854434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 605/1180] 10.222.0.20 () {56 vars in 1131 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:16.860301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.870177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d1b0-3bd1-4232-a989-ad14b55251b1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.874650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.878195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.878195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.878195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.883262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.885210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.897709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING keystone.server.flask.application [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 22:11:16.901166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 576/1181] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:16.904890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.914225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3b237-3986-42a4-ae90-e2b960dd55e0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.918746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.919379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.919663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.919939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.920745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:16.921053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.922837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f9f96-3fa5-4d75-b7d1-491fcf91c67c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.935141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 606/1182] 10.222.0.20 () {56 vars in 1170 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:11:16.941998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:16.952049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187d493-26f0-45e9-b03f-d7b180899328 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:16.956563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:16.957179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:16.957459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:16.957732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:16.958541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] RBAC: Adding query filter params (role.id=ea69f9c310e340ff88a42ee56ce63ff0, scope.project.id=d23bf3fa5aa24998a1474108d98fd29d, user.id=5270a4882c43439489e806c1c15a2e86) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:16.958847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:16.960653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e403509-6709-4e95-a2b8-40de1a6d67be admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:16.966132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 577/1183] 10.222.0.20 () {56 vars in 1396 bytes} [Tue Sep 14 22:11:16 2021] GET /identity/v3/role_assignments?user.id=5270a4882c43439489e806c1c15a2e86&scope.project.id=d23bf3fa5aa24998a1474108d98fd29d&role.id=ea69f9c310e340ff88a42ee56ce63ff0 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:19.162748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a315ed-2ac4-48e0-b744-a2d6bef937bc None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:19.163304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a315ed-2ac4-48e0-b744-a2d6bef937bc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:19.163304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a315ed-2ac4-48e0-b744-a2d6bef937bc None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:19.165098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 607/1184] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:19.172394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:19.172820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:19.172970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:19.190715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:19.192560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:19.200192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 578/1185] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:19.223926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a315ed-2ac4-48e0-b744-a2d6bef937bc None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:19.236347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a315ed-2ac4-48e0-b744-a2d6bef937bc None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:19.243507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:19.244292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:19.244680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:19.244961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:19.245611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:19.247177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:19.258123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 22:11:19.259257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 608/1186] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:11:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:19.266157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:19.275099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea159c-c26f-4c25-b767-65820c31f62b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:19.279728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:19.280376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:19.280701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:19.281023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:19.281781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:19.282087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:19.283687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581f856-1726-4c4e-ab69-9b70ca1ff60d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:19.289188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 579/1187] 10.222.0.20 () {56 vars in 1138 bytes} [Tue Sep 14 22:11:19 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:19.295699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:19.305788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa5260-58ff-4de7-b16d-2f078c2804fb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:19.310330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:19.313569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:19.313569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:19.313569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] PATH_INFO: `/v3/services` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:19.313569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:19.313569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:19.314148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a673b33-492a-4c64-8b51-244d9389dfd5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:19.318446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 609/1188] 10.222.0.20 () {56 vars in 1138 bytes} [Tue Sep 14 22:11:19 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:11:21.422265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba49e8e-8193-427b-a036-6651d8569b45 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:21.422816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba49e8e-8193-427b-a036-6651d8569b45 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:21.422816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba49e8e-8193-427b-a036-6651d8569b45 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:21.424613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 580/1189] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:21.431865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03933b9b-ee4b-4492-9ca6-00e7884de546 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:21.432309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03933b9b-ee4b-4492-9ca6-00e7884de546 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:21.432436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03933b9b-ee4b-4492-9ca6-00e7884de546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:21.450103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-03933b9b-ee4b-4492-9ca6-00e7884de546 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:21.451275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-03933b9b-ee4b-4492-9ca6-00e7884de546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:21.459475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 610/1190] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:21.482808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba49e8e-8193-427b-a036-6651d8569b45 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:21.494736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba49e8e-8193-427b-a036-6651d8569b45 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:21.498982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72135-70c7-4768-bc70-4849e8daf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:21.499619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72135-70c7-4768-bc70-4849e8daf9aa admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:21.499899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72135-70c7-4768-bc70-4849e8daf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:21.500171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72135-70c7-4768-bc70-4849e8daf9aa admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:21.500921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72135-70c7-4768-bc70-4849e8daf9aa admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:21.502495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72135-70c7-4768-bc70-4849e8daf9aa admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:21.641869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 581/1191] 10.222.0.20 () {60 vars in 1163 bytes} [Tue Sep 14 22:11:21 2021] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:11:23.783163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dbf1f-9a82-432c-a020-2ad27a77d5f9 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:23.783701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dbf1f-9a82-432c-a020-2ad27a77d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:23.783701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dbf1f-9a82-432c-a020-2ad27a77d5f9 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:23.786035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 611/1192] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:23.793141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:23.793582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:23.793716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:23.811789 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:23.812994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:23.829365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 582/1193] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:11:23.853540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dbf1f-9a82-432c-a020-2ad27a77d5f9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:23.866599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dbf1f-9a82-432c-a020-2ad27a77d5f9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:23.871036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:23.871865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:23.872143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:23.872428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:23.873082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:23.874640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:23.885400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 22:11:23.886508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 612/1194] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:11:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:23.893007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:23.901730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca0937-f27d-48d9-bfd8-1856e772a314 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:23.906248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:23.906895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:23.907179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:23.907455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:23.908154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:23.908494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:23.910574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:23.915571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 583/1195] 10.222.0.20 () {56 vars in 1138 bytes} [Tue Sep 14 22:11:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:23.921660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:23.931465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83b81-35f1-4fe3-b284-b899923645b6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:23.936043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:23.936687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:23.936971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:23.937313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:23.938090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] RBAC: Adding query filter params (interface=public, service_id=097c0a4aed614f22b6ba4dc610254967, region_id=RegionOne) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:23.938400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:23.939936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e236c-81c5-415f-b1f7-ea0a307eba95 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:23.944870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 613/1196] 10.222.0.20 () {56 vars in 1273 bytes} [Tue Sep 14 22:11:23 2021] GET /identity/v3/endpoints?service_id=097c0a4aed614f22b6ba4dc610254967&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:23.950606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:23.959980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070c4c5-f98c-485e-9afb-1292e57bbebe admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:23.964551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd2f96-bf68-41a1-ade2-63d01c23f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:23.965187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2f96-bf68-41a1-ade2-63d01c23f88f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:23.965475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2f96-bf68-41a1-ade2-63d01c23f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:23.965756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2f96-bf68-41a1-ade2-63d01c23f88f admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:23.966423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd2f96-bf68-41a1-ade2-63d01c23f88f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:23.967982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd2f96-bf68-41a1-ade2-63d01c23f88f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:23.975169 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 584/1197] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:11:23 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:11:26.126016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c673-8fc1-4191-955a-5d57f18fd28b None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:26.126594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c673-8fc1-4191-955a-5d57f18fd28b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:26.126594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587c673-8fc1-4191-955a-5d57f18fd28b None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:26.128868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 614/1198] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:11:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:11:26.135956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:26.136371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:26.136547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:26.154986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:11:26.156172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:11:26.164087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 585/1199] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:11:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:11:26.187393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587c673-8fc1-4191-955a-5d57f18fd28b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:26.200383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587c673-8fc1-4191-955a-5d57f18fd28b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:26.204844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:26.205772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:26.206670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:26.206953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:26.207610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:26.209259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:26.219989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING keystone.server.flask.application [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 22:11:26.221160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 615/1200] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 14 22:11:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 22:11:26.227672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:26.236808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533c71b-883a-4e8f-aefa-c43001986346 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:26.241619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:26.242285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:26.242572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:26.242852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] PATH_INFO: `/v3/services` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:26.243562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:11:26.243875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:26.245495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8bee0-6640-4bf6-909a-39b918b28a1d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:26.250800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 586/1201] 10.222.0.20 () {56 vars in 1138 bytes} [Tue Sep 14 22:11:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:11:26.257640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:11:26.267654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577a91c-01eb-4fc4-bc6e-8fd792a2977d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:11:26.273061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:11:26.273696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:11:26.274098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:11:26.274389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:11:26.275135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:11:26.276118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:11:26.276118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:11:26.276118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:11:26.277047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787cbda-8c45-4e6b-97e1-d8863ca578b3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:11:26.372822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 616/1202] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Sep 14 22:11:26 2021] POST /identity/v3/endpoints => generated 331 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:17:14.325645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9258a-b0c8-4bc5-9768-2b8206bce6a1 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:14.326218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9258a-b0c8-4bc5-9768-2b8206bce6a1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:14.326477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9258a-b0c8-4bc5-9768-2b8206bce6a1 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:14.328656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 587/1203] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:14.335982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952ff9-5ee1-420d-b051-f9ed1e540349 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:14.336491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952ff9-5ee1-420d-b051-f9ed1e540349 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:14.336580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952ff9-5ee1-420d-b051-f9ed1e540349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:14.419462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4c952ff9-5ee1-420d-b051-f9ed1e540349 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:14.420736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4c952ff9-5ee1-420d-b051-f9ed1e540349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:14.530007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 617/1204] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:14.545503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9258a-b0c8-4bc5-9768-2b8206bce6a1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:14.547247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1bc9258a-b0c8-4bc5-9768-2b8206bce6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:14.685348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9258a-b0c8-4bc5-9768-2b8206bce6a1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:14.781437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8c6f4-9515-4559-9052-afe4fa33559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:14.782102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8c6f4-9515-4559-9052-afe4fa33559d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:14.782383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8c6f4-9515-4559-9052-afe4fa33559d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:14.782653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8c6f4-9515-4559-9052-afe4fa33559d admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:14.783371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8c6f4-9515-4559-9052-afe4fa33559d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:14.785229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8c6f4-9515-4559-9052-afe4fa33559d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:14.803532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 588/1205] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:17:14 2021] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:17:16.998346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdbe30-48dc-4981-b31f-1024d8737862 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:16.998866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdbe30-48dc-4981-b31f-1024d8737862 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:16.998982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdbe30-48dc-4981-b31f-1024d8737862 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:17.000700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 618/1206] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:17.007681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db957c5-8085-4ad9-aa5f-c79ed5650f50 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:17.008092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db957c5-8085-4ad9-aa5f-c79ed5650f50 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:17.008233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db957c5-8085-4ad9-aa5f-c79ed5650f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:17.074847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5db957c5-8085-4ad9-aa5f-c79ed5650f50 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:17.076030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5db957c5-8085-4ad9-aa5f-c79ed5650f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:17.166736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 589/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:17:17.219031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5459092-ccaf-49c0-9514-010142207e4f None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:17.219321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5459092-ccaf-49c0-9514-010142207e4f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:17.219606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5459092-ccaf-49c0-9514-010142207e4f None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:17.221423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 619/1208] 10.222.0.20 () {54 vars in 964 bytes} [Tue Sep 14 22:17:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:17.228257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366082-718f-415b-ae6c-033963c1b5ae None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:17.228606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366082-718f-415b-ae6c-033963c1b5ae None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:17.228887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366082-718f-415b-ae6c-033963c1b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:17.302912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5c366082-718f-415b-ae6c-033963c1b5ae None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:17.304092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5c366082-718f-415b-ae6c-033963c1b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:17.375389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 590/1209] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 14 22:17:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:17:17.384465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5459092-ccaf-49c0-9514-010142207e4f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:17.385982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e5459092-ccaf-49c0-9514-010142207e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:17.487987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5459092-ccaf-49c0-9514-010142207e4f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:17.557569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:17.558154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:17.558438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:17.558716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:17.560348 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:17.664054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:17.665532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f557cd-6d26-4735-91f7-575f5b1ab2ac service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:17.683623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 620/1210] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:20.110451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219483-18a8-4ed6-ba54-16e1e79d9842 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:20.110980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219483-18a8-4ed6-ba54-16e1e79d9842 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:20.111093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219483-18a8-4ed6-ba54-16e1e79d9842 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:20.112793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 591/1211] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:20.120289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e775-61a4-498f-ba8f-d196b57fe694 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:20.120770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e775-61a4-498f-ba8f-d196b57fe694 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:20.120864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e775-61a4-498f-ba8f-d196b57fe694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:20.182522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3aa5e775-61a4-498f-ba8f-d196b57fe694 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:20.183707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3aa5e775-61a4-498f-ba8f-d196b57fe694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:20.275857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 621/1212] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:20.314669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219483-18a8-4ed6-ba54-16e1e79d9842 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:20.316177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-54219483-18a8-4ed6-ba54-16e1e79d9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:20.413648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219483-18a8-4ed6-ba54-16e1e79d9842 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:20.490662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:20.491313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:20.491599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:20.491872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:20.493530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:20.596219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:20.598292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664e342-7a78-456d-ae2e-6faba487d567 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:20.616015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 592/1213] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:23.275001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41a9a-7cf3-4916-b08e-d3826b3a3fc1 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:23.275451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41a9a-7cf3-4916-b08e-d3826b3a3fc1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:23.275544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41a9a-7cf3-4916-b08e-d3826b3a3fc1 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:23.277382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 622/1214] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:23.284330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:23.284735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:23.285537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:23.346630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:23.348467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:23.438961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 593/1215] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:23.476407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41a9a-7cf3-4916-b08e-d3826b3a3fc1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:23.478354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-44d41a9a-7cf3-4916-b08e-d3826b3a3fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:23.593997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41a9a-7cf3-4916-b08e-d3826b3a3fc1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:23.681298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119348d7-959c-4fbf-815b-3ce5e510860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:23.682142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119348d7-959c-4fbf-815b-3ce5e510860e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:23.682426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119348d7-959c-4fbf-815b-3ce5e510860e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:23.682701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119348d7-959c-4fbf-815b-3ce5e510860e admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:23.693372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119348d7-959c-4fbf-815b-3ce5e510860e admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:23.695506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119348d7-959c-4fbf-815b-3ce5e510860e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:23.697274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 623/1216] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:17:23 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:17:23.710551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:23.711808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:23.802079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df8433-c791-44e6-b989-572fbe4a14d4 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:23.870429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:23.871008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:23.871292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:23.871567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:23.873202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:23.974522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:23.975925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c531a5-37f2-446b-ab65-5eeb59ad17ea service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:23.995562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 594/1217] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:26.869941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644cee-ffd2-49f3-9795-66367a09437e None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:26.870429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644cee-ffd2-49f3-9795-66367a09437e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:26.870529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644cee-ffd2-49f3-9795-66367a09437e None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:26.872258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 624/1218] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:26.879323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:26.879748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:26.879889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:26.941697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:26.942940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:27.033686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 595/1219] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:27.067891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644cee-ffd2-49f3-9795-66367a09437e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:27.069424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3f644cee-ffd2-49f3-9795-66367a09437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:27.186953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644cee-ffd2-49f3-9795-66367a09437e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:27.276117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b88931-60b3-4428-a149-fae9b2fdbc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:27.277062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88931-60b3-4428-a149-fae9b2fdbc75 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:27.277346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88931-60b3-4428-a149-fae9b2fdbc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:27.277619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b88931-60b3-4428-a149-fae9b2fdbc75 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:27.286863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b88931-60b3-4428-a149-fae9b2fdbc75 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:27.288921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b88931-60b3-4428-a149-fae9b2fdbc75 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:27.290586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 625/1220] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:17:27 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:17:27.303292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:27.304517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:27.390653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f701-ca38-4f9f-8bb8-61f66e34ce21 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:27.459249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:27.459823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:27.460155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:27.460451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:27.462046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:27.563091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:27.564516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12bc84-8e30-40e5-b342-c993c7d9b897 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:27.581378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 596/1221] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:30.671895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ed80b-16c6-42e2-b461-6cbdc7f2528c None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:30.672466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ed80b-16c6-42e2-b461-6cbdc7f2528c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:30.672564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ed80b-16c6-42e2-b461-6cbdc7f2528c None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:30.674445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 626/1222] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:30.681453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b05d-fa55-41ec-b054-70c2382740ad None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:30.681846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b05d-fa55-41ec-b054-70c2382740ad None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:30.682027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b05d-fa55-41ec-b054-70c2382740ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:30.747943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b584b05d-fa55-41ec-b054-70c2382740ad None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:30.749746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b584b05d-fa55-41ec-b054-70c2382740ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:30.852108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 597/1223] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:30.889654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ed80b-16c6-42e2-b461-6cbdc7f2528c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:30.891179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bd7ed80b-16c6-42e2-b461-6cbdc7f2528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:30.991432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ed80b-16c6-42e2-b461-6cbdc7f2528c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:31.059839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:31.060521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:31.060805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:31.061078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:31.062683 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:31.165978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:31.167319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a75e5c-22ea-4263-beae-b709bd4e744e service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:31.185252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 627/1224] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:33.380366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5c4d-0a84-4402-9423-41d673583acb None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:33.380952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5c4d-0a84-4402-9423-41d673583acb None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:33.380952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5c4d-0a84-4402-9423-41d673583acb None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:33.382753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 598/1225] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:33.389919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669c66f-ed20-428a-86aa-7d619e00b786 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:33.390339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669c66f-ed20-428a-86aa-7d619e00b786 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:33.390579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669c66f-ed20-428a-86aa-7d619e00b786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:33.452922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2669c66f-ed20-428a-86aa-7d619e00b786 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:33.454116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2669c66f-ed20-428a-86aa-7d619e00b786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:33.551163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 628/1226] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:33.588563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5c4d-0a84-4402-9423-41d673583acb None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:33.590085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-026b5c4d-0a84-4402-9423-41d673583acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:33.689738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5c4d-0a84-4402-9423-41d673583acb None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:33.762605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:33.763294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:33.763571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:33.763849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:33.765487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:33.873834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:33.875297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2efa6e-f3a5-43b1-8fa2-45f709cdd616 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:33.895588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 599/1227] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:36.115828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8a98-a792-4a8e-8275-fbd3c2da9622 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:36.116475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8a98-a792-4a8e-8275-fbd3c2da9622 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:36.116475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8a98-a792-4a8e-8275-fbd3c2da9622 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:36.118545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 629/1228] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:36.126552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:36.127108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:36.127108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:36.191729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:36.192955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:36.285855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 600/1229] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:36.319828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8a98-a792-4a8e-8275-fbd3c2da9622 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:36.321380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-71bd8a98-a792-4a8e-8275-fbd3c2da9622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:36.442308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8a98-a792-4a8e-8275-fbd3c2da9622 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:36.531771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61573928-1209-4b7c-8042-00de8f74acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:36.532658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573928-1209-4b7c-8042-00de8f74acf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:36.532944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573928-1209-4b7c-8042-00de8f74acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:36.533225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573928-1209-4b7c-8042-00de8f74acf1 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:36.543275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61573928-1209-4b7c-8042-00de8f74acf1 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:36.545367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61573928-1209-4b7c-8042-00de8f74acf1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:36.547230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 630/1230] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:17:36 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:17:36.559968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:36.561296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:36.648862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694fda0-90f7-4517-88d4-ce67f032123d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:36.720073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:36.720670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:36.720952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:36.721226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:36.722870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:36.830198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:36.831664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b227d-24c6-47fb-ae4d-6e000704a57b service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:36.848963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 601/1231] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:39.360078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836e2c-325d-4657-a222-99a25fa36b97 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:39.360742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836e2c-325d-4657-a222-99a25fa36b97 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:39.360742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836e2c-325d-4657-a222-99a25fa36b97 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:39.362485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 631/1232] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:17:39.370423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679657b-de6d-4d82-8681-94d0f0d5393f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:39.370849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679657b-de6d-4d82-8681-94d0f0d5393f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:39.371006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679657b-de6d-4d82-8681-94d0f0d5393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:39.433771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6679657b-de6d-4d82-8681-94d0f0d5393f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:39.434969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6679657b-de6d-4d82-8681-94d0f0d5393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:39.526326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 602/1233] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:39.562332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36836e2c-325d-4657-a222-99a25fa36b97 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:39.563836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-36836e2c-325d-4657-a222-99a25fa36b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:39.661467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36836e2c-325d-4657-a222-99a25fa36b97 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:39.732397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:39.733483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:39.733943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:39.734209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:39.735847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:39.838682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:39.840100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72783234-0f4a-4b11-b1d4-49653526dde8 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:39.857613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 632/1234] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:42.061460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6292-c05a-4ffb-9b5a-9fafa99f81c1 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:42.062027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6292-c05a-4ffb-9b5a-9fafa99f81c1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:42.062027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6292-c05a-4ffb-9b5a-9fafa99f81c1 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:42.063783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 603/1235] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:42.071469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8dca-cdeb-45ad-a241-38755a748814 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:42.071896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8dca-cdeb-45ad-a241-38755a748814 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:42.072036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8dca-cdeb-45ad-a241-38755a748814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:42.135051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c50c8dca-cdeb-45ad-a241-38755a748814 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:42.136231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c50c8dca-cdeb-45ad-a241-38755a748814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:42.229835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 633/1236] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:42.271917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6292-c05a-4ffb-9b5a-9fafa99f81c1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:42.273500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-032b6292-c05a-4ffb-9b5a-9fafa99f81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:42.372133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6292-c05a-4ffb-9b5a-9fafa99f81c1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:42.440925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:42.441571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:42.441851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:42.442127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:42.443712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:42.546711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:42.548117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33810-d354-440b-8a8a-f63df535d9ec service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:42.567214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 604/1237] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:45.331280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86003184-7d97-47b2-8c4c-3b1a5caa4e4d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:45.331828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86003184-7d97-47b2-8c4c-3b1a5caa4e4d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:45.331828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86003184-7d97-47b2-8c4c-3b1a5caa4e4d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:45.333653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 634/1238] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:45.340714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6082-8136-4d95-af8e-8cb898ff7a8b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:45.341103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6082-8136-4d95-af8e-8cb898ff7a8b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:45.341272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6082-8136-4d95-af8e-8cb898ff7a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:45.409140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-47ee6082-8136-4d95-af8e-8cb898ff7a8b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:45.410348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-47ee6082-8136-4d95-af8e-8cb898ff7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:45.508359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 605/1239] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:45.544978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86003184-7d97-47b2-8c4c-3b1a5caa4e4d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:45.547078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-86003184-7d97-47b2-8c4c-3b1a5caa4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:45.637354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86003184-7d97-47b2-8c4c-3b1a5caa4e4d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:45.640913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22024f-40a4-459b-94d1-ea615285fa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:45.641548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22024f-40a4-459b-94d1-ea615285fa65 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:45.641827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22024f-40a4-459b-94d1-ea615285fa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:45.642101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22024f-40a4-459b-94d1-ea615285fa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:45.651294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22024f-40a4-459b-94d1-ea615285fa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:45.652719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22024f-40a4-459b-94d1-ea615285fa65 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:45.661750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 635/1240] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:49.937004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc9dc-a3a1-4663-98c6-86f4ba200d10 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:49.937485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc9dc-a3a1-4663-98c6-86f4ba200d10 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:49.937589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc9dc-a3a1-4663-98c6-86f4ba200d10 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:49.939437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 606/1241] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:17:49.947722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddf82-d29d-41af-9b69-b600bf41bcc4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:49.948180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddf82-d29d-41af-9b69-b600bf41bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:49.948273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddf82-d29d-41af-9b69-b600bf41bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:49.966137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ad4ddf82-d29d-41af-9b69-b600bf41bcc4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:49.973003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ad4ddf82-d29d-41af-9b69-b600bf41bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:49.975473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 636/1242] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:50.016049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc9dc-a3a1-4663-98c6-86f4ba200d10 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:50.027035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc9dc-a3a1-4663-98c6-86f4ba200d10 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:50.030517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003142-3b3d-462c-90b7-ff4381af0cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:50.031150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003142-3b3d-462c-90b7-ff4381af0cfe service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:50.031430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003142-3b3d-462c-90b7-ff4381af0cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:50.031703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003142-3b3d-462c-90b7-ff4381af0cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:50.040555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003142-3b3d-462c-90b7-ff4381af0cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:50.041964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d003142-3b3d-462c-90b7-ff4381af0cfe service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:50.051300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 607/1243] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:53.155067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb143b-db97-4c33-9122-5e989ef0e67a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:53.155563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb143b-db97-4c33-9122-5e989ef0e67a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:53.155563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb143b-db97-4c33-9122-5e989ef0e67a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:53.157379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 637/1244] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:53.164580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3521a6-48f6-489d-8b7f-75ba097006a7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:53.165044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3521a6-48f6-489d-8b7f-75ba097006a7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:53.165140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3521a6-48f6-489d-8b7f-75ba097006a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:53.182620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3d3521a6-48f6-489d-8b7f-75ba097006a7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:53.183793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3d3521a6-48f6-489d-8b7f-75ba097006a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:53.197732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 608/1245] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:53.249727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc1e89-391a-4a02-b9ae-dafeef09c505 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:53.250096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc1e89-391a-4a02-b9ae-dafeef09c505 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:53.250499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc1e89-391a-4a02-b9ae-dafeef09c505 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:53.252361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 638/1246] 10.222.0.20 () {54 vars in 964 bytes} [Tue Sep 14 22:17:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:53.259315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787b369-953a-429b-9042-3a6dc58bbc98 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:53.259608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787b369-953a-429b-9042-3a6dc58bbc98 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:53.259890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787b369-953a-429b-9042-3a6dc58bbc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:53.313257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6787b369-953a-429b-9042-3a6dc58bbc98 None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:53.314433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6787b369-953a-429b-9042-3a6dc58bbc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:53.321534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 609/1247] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 14 22:17:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:53.330476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc1e89-391a-4a02-b9ae-dafeef09c505 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:53.341249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc1e89-391a-4a02-b9ae-dafeef09c505 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:53.344887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3a2f1-ea60-4a03-a2af-f6055cf65b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:53.345525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3a2f1-ea60-4a03-a2af-f6055cf65b5d service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:53.345810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3a2f1-ea60-4a03-a2af-f6055cf65b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:53.346087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3a2f1-ea60-4a03-a2af-f6055cf65b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:53.354796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3a2f1-ea60-4a03-a2af-f6055cf65b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:53.356220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3a2f1-ea60-4a03-a2af-f6055cf65b5d service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:53.366338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 639/1248] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:17:58.620662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f13b0-b913-46cb-8580-92821ed5eca2 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:58.621239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f13b0-b913-46cb-8580-92821ed5eca2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:58.621239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f13b0-b913-46cb-8580-92821ed5eca2 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:58.624744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 610/1249] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:17:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:17:58.631545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344459c-46c1-4894-b6d0-e0bc4de0d89d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:58.632079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344459c-46c1-4894-b6d0-e0bc4de0d89d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:58.632079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344459c-46c1-4894-b6d0-e0bc4de0d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:58.650328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e344459c-46c1-4894-b6d0-e0bc4de0d89d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:17:58.651414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e344459c-46c1-4894-b6d0-e0bc4de0d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:17:58.659283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 640/1250] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:17:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:17:58.697904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f13b0-b913-46cb-8580-92821ed5eca2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:17:58.709437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f13b0-b913-46cb-8580-92821ed5eca2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:17:58.713136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be37537-2699-4cb0-8efc-53c71a3c59b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:17:58.713892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be37537-2699-4cb0-8efc-53c71a3c59b3 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:17:58.714181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be37537-2699-4cb0-8efc-53c71a3c59b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:17:58.714457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be37537-2699-4cb0-8efc-53c71a3c59b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:17:58.724957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be37537-2699-4cb0-8efc-53c71a3c59b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:17:58.726409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be37537-2699-4cb0-8efc-53c71a3c59b3 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:17:58.737586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 611/1251] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:17:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:03.780075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32ea1-dde9-4f9c-85b4-6805ce713c3a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:03.780659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32ea1-dde9-4f9c-85b4-6805ce713c3a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:03.780659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32ea1-dde9-4f9c-85b4-6805ce713c3a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:03.782716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 641/1252] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:18:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:03.789200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c107b6c-376b-451a-894d-5d820cc4d7b5 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:03.789978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c107b6c-376b-451a-894d-5d820cc4d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:03.790457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c107b6c-376b-451a-894d-5d820cc4d7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:03.867200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4c107b6c-376b-451a-894d-5d820cc4d7b5 None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:03.868695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4c107b6c-376b-451a-894d-5d820cc4d7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:03.961335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 612/1253] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:18:03 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:08.182890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16816a-c05d-409f-99a2-1b4b67e42e1d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:08.183478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16816a-c05d-409f-99a2-1b4b67e42e1d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:08.183774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16816a-c05d-409f-99a2-1b4b67e42e1d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:08.185883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 642/1254] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:18:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:08.191717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa4d1-3111-49c9-9793-d889535ee040 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:08.192184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa4d1-3111-49c9-9793-d889535ee040 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:08.192510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa4d1-3111-49c9-9793-d889535ee040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:08.211064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b73fa4d1-3111-49c9-9793-d889535ee040 None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:08.212377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b73fa4d1-3111-49c9-9793-d889535ee040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:08.221467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 613/1255] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:18:08 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:09.748914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a836c-5cc3-4079-9e5d-260169c20bfc None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:09.749460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a836c-5cc3-4079-9e5d-260169c20bfc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:09.749561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a836c-5cc3-4079-9e5d-260169c20bfc None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:09.751377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 643/1256] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:18:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:09.757483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd45ea-fef3-4eb9-b8b2-5247198feec8 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:09.757894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd45ea-fef3-4eb9-b8b2-5247198feec8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:09.758191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd45ea-fef3-4eb9-b8b2-5247198feec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:09.776544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-73dd45ea-fef3-4eb9-b8b2-5247198feec8 None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:09.777723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-73dd45ea-fef3-4eb9-b8b2-5247198feec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:09.786166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 614/1257] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:18:09 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:13.570869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5faede-b6ce-4e93-8aba-818f6560e5ef None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:13.571445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5faede-b6ce-4e93-8aba-818f6560e5ef None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:13.571445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5faede-b6ce-4e93-8aba-818f6560e5ef None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:13.573465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 644/1258] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:13.581091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c092d3-840e-4134-88d0-0c96dcb9bca6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:13.581569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c092d3-840e-4134-88d0-0c96dcb9bca6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:13.581657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c092d3-840e-4134-88d0-0c96dcb9bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:13.600628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-30c092d3-840e-4134-88d0-0c96dcb9bca6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:13.602079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-30c092d3-840e-4134-88d0-0c96dcb9bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:13.611849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 615/1259] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:13.663507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a98c9-3862-4ee1-8e75-9cba546dcf6e None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:13.664043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a98c9-3862-4ee1-8e75-9cba546dcf6e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:13.664466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a98c9-3862-4ee1-8e75-9cba546dcf6e None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:13.666325 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 645/1260] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 14 22:18:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:13.672126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896ef7-5c5a-4434-b700-e4753c6eb906 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:13.672550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896ef7-5c5a-4434-b700-e4753c6eb906 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:13.672926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896ef7-5c5a-4434-b700-e4753c6eb906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:13.722945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-97896ef7-5c5a-4434-b700-e4753c6eb906 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:13.724339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-97896ef7-5c5a-4434-b700-e4753c6eb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:13.806166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 616/1261] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 14 22:18:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:18:13.814467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a98c9-3862-4ee1-8e75-9cba546dcf6e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:13.834876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a98c9-3862-4ee1-8e75-9cba546dcf6e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:13.834876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c959-fd66-4b28-a424-4cc1caf94de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:13.835391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c959-fd66-4b28-a424-4cc1caf94de2 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:13.835679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c959-fd66-4b28-a424-4cc1caf94de2 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:13.835959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c959-fd66-4b28-a424-4cc1caf94de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:13.844528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89c959-fd66-4b28-a424-4cc1caf94de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:13.846951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89c959-fd66-4b28-a424-4cc1caf94de2 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:13.857242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 646/1262] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:16.283809 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19ac7-04b0-4cb4-809d-fada30c78522 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:16.284362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19ac7-04b0-4cb4-809d-fada30c78522 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:16.284362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19ac7-04b0-4cb4-809d-fada30c78522 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:16.286495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 617/1263] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:16.294321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11973272-14f2-4a03-b841-c2bf346e3842 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:16.294823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11973272-14f2-4a03-b841-c2bf346e3842 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:16.295237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11973272-14f2-4a03-b841-c2bf346e3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:16.313880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-11973272-14f2-4a03-b841-c2bf346e3842 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:16.315277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-11973272-14f2-4a03-b841-c2bf346e3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:16.323140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 647/1264] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:16.369616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19ac7-04b0-4cb4-809d-fada30c78522 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:16.383969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19ac7-04b0-4cb4-809d-fada30c78522 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:16.389762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a8cc7-9684-4be2-b1fe-92ab5302b5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:16.390399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8cc7-9684-4be2-b1fe-92ab5302b5d8 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:16.390685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8cc7-9684-4be2-b1fe-92ab5302b5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:16.390970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8cc7-9684-4be2-b1fe-92ab5302b5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:16.401426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a8cc7-9684-4be2-b1fe-92ab5302b5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:16.402938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a8cc7-9684-4be2-b1fe-92ab5302b5d8 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:16.412394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 618/1265] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:19.002632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184bfb-b0dc-406f-ad42-f8d2e7fe6513 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:19.003098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184bfb-b0dc-406f-ad42-f8d2e7fe6513 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:19.003191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184bfb-b0dc-406f-ad42-f8d2e7fe6513 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:19.005018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 648/1266] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:19.012189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab8e5-7d49-416a-aa50-49933637366b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:19.012671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab8e5-7d49-416a-aa50-49933637366b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:19.012955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab8e5-7d49-416a-aa50-49933637366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:19.031049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-cbaab8e5-7d49-416a-aa50-49933637366b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:19.032219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-cbaab8e5-7d49-416a-aa50-49933637366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:19.041420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 619/1267] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:18:19.087867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30c7b-0666-4d56-8555-106e46e438e0 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:19.088276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30c7b-0666-4d56-8555-106e46e438e0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:19.088635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30c7b-0666-4d56-8555-106e46e438e0 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:19.090460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 649/1268] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 14 22:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:19.098125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028558f1-774a-48fa-8acd-fa457512e35c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:19.098503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028558f1-774a-48fa-8acd-fa457512e35c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:19.098858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028558f1-774a-48fa-8acd-fa457512e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:19.123504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-028558f1-774a-48fa-8acd-fa457512e35c None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:19.125061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-028558f1-774a-48fa-8acd-fa457512e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:19.136525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 620/1269] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 14 22:18:19 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:19.146570 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30c7b-0666-4d56-8555-106e46e438e0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:19.164551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30c7b-0666-4d56-8555-106e46e438e0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:19.170515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3a85-3974-4e06-836c-7b8d3f400b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:19.171308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3a85-3974-4e06-836c-7b8d3f400b4e service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:19.171693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3a85-3974-4e06-836c-7b8d3f400b4e service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:19.172082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3a85-3974-4e06-836c-7b8d3f400b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:19.181268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f3a85-3974-4e06-836c-7b8d3f400b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:19.183779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f3a85-3974-4e06-836c-7b8d3f400b4e service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:19.194365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 650/1270] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:21.434328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3bd97-7518-4733-a1d2-b2de364917ef None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.434845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3bd97-7518-4733-a1d2-b2de364917ef None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.435135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3bd97-7518-4733-a1d2-b2de364917ef None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.436885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 621/1271] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:21.444863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a82d84-1b1d-47b4-b7b7-2540bdf699d5 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.445346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a82d84-1b1d-47b4-b7b7-2540bdf699d5 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.445430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a82d84-1b1d-47b4-b7b7-2540bdf699d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.463787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-16a82d84-1b1d-47b4-b7b7-2540bdf699d5 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:21.465008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-16a82d84-1b1d-47b4-b7b7-2540bdf699d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:21.473146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 651/1272] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:21.528162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5205-a4a7-4e30-a002-875f83bfae89 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.528449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5205-a4a7-4e30-a002-875f83bfae89 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.528897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd5205-a4a7-4e30-a002-875f83bfae89 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.531206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 622/1273] 10.222.0.20 () {54 vars in 967 bytes} [Tue Sep 14 22:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:21.537521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.537876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.538256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.592236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] MFA Rules not processed for user `bc75144a14f943a7adcb56dfdb808ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:21.593495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:21.630085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fceede-99be-4a4d-85db-f0fcc7e5a7ec None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.630381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fceede-99be-4a4d-85db-f0fcc7e5a7ec None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.630751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fceede-99be-4a4d-85db-f0fcc7e5a7ec None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.632645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 623/1274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:18:21.640941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.641274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.641508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.659481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 652/1275] 10.222.0.20 () {58 vars in 1065 bytes} [Tue Sep 14 22:18:21 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:21.669950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:21.670062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:21.670144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:21.674472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7242e-1e0c-4a09-bf09-14f7b81c25e1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:21.676317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 624/1276] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:21.682292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d880-509d-4294-8bf2-fac03c83618b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:21.682929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d880-509d-4294-8bf2-fac03c83618b service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.683203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d880-509d-4294-8bf2-fac03c83618b service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.683474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d880-509d-4294-8bf2-fac03c83618b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.693352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d880-509d-4294-8bf2-fac03c83618b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:21.694652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d880-509d-4294-8bf2-fac03c83618b service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:21.704105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 653/1277] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:18:21.723479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:21.738184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccc1b8-5115-4b6d-b7ab-a216ab78655b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:21.743772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582e19f-70b4-45be-bf4f-ddf0f3c4aeef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:21.744470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e19f-70b4-45be-bf4f-ddf0f3c4aeef service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:21.744765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e19f-70b4-45be-bf4f-ddf0f3c4aeef service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:21.745046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e19f-70b4-45be-bf4f-ddf0f3c4aeef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:21.753825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582e19f-70b4-45be-bf4f-ddf0f3c4aeef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:21.755397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582e19f-70b4-45be-bf4f-ddf0f3c4aeef service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:21.764820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 625/1278] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:24.134362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f24b3a-b592-4a8b-ab79-422c4ef384f0 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:24.134850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f24b3a-b592-4a8b-ab79-422c4ef384f0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:24.134850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f24b3a-b592-4a8b-ab79-422c4ef384f0 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:24.136837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 654/1279] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:24.144354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66044c-18a3-401c-b767-3734812ef8c0 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:24.144819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66044c-18a3-401c-b767-3734812ef8c0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:24.144998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66044c-18a3-401c-b767-3734812ef8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:24.162941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8b66044c-18a3-401c-b767-3734812ef8c0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:24.164106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8b66044c-18a3-401c-b767-3734812ef8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:24.171746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 626/1280] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:18:24.217064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f24b3a-b592-4a8b-ab79-422c4ef384f0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:24.231492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f24b3a-b592-4a8b-ab79-422c4ef384f0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:24.238511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ec1f-499d-4a68-9447-d01c69cbdcef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:24.239237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ec1f-499d-4a68-9447-d01c69cbdcef service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:24.239593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ec1f-499d-4a68-9447-d01c69cbdcef service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:24.239942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ec1f-499d-4a68-9447-d01c69cbdcef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:24.248811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ec1f-499d-4a68-9447-d01c69cbdcef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:24.250381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ec1f-499d-4a68-9447-d01c69cbdcef service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:24.259507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 655/1281] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:26.622378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f089b-8d9c-44f7-9754-e4031be75bbc None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:26.622918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f089b-8d9c-44f7-9754-e4031be75bbc None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:26.623014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f089b-8d9c-44f7-9754-e4031be75bbc None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:26.624902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 627/1282] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:26.632681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee19882-e0a8-4048-af19-020f94535e00 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:26.633117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee19882-e0a8-4048-af19-020f94535e00 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:26.633269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee19882-e0a8-4048-af19-020f94535e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:26.652259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-eee19882-e0a8-4048-af19-020f94535e00 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:26.653475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-eee19882-e0a8-4048-af19-020f94535e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:26.662396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 656/1283] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:26.709067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f089b-8d9c-44f7-9754-e4031be75bbc None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:26.724804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f089b-8d9c-44f7-9754-e4031be75bbc None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:26.751384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f08297-94ec-40d2-922d-d2486f4a9f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:26.751384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f08297-94ec-40d2-922d-d2486f4a9f78 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:26.751384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f08297-94ec-40d2-922d-d2486f4a9f78 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:26.751384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f08297-94ec-40d2-922d-d2486f4a9f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:26.751802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f08297-94ec-40d2-922d-d2486f4a9f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:26.751802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f08297-94ec-40d2-922d-d2486f4a9f78 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:26.754135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 628/1284] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:29.559682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a605d2-446c-4690-ae98-67d4b357fa07 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:29.560344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a605d2-446c-4690-ae98-67d4b357fa07 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:29.560492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a605d2-446c-4690-ae98-67d4b357fa07 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:29.562414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 657/1285] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:29.570532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870800be-63ca-4e5f-9075-b87a0e23b7cc None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:29.571020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870800be-63ca-4e5f-9075-b87a0e23b7cc None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:29.571113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870800be-63ca-4e5f-9075-b87a0e23b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:29.588787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-870800be-63ca-4e5f-9075-b87a0e23b7cc None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:29.589964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-870800be-63ca-4e5f-9075-b87a0e23b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:29.598343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 629/1286] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:29.643534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a605d2-446c-4690-ae98-67d4b357fa07 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:29.661157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a605d2-446c-4690-ae98-67d4b357fa07 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:29.667894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af5c0d-efbb-4725-bcf9-3e10166569d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:29.668726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5c0d-efbb-4725-bcf9-3e10166569d6 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:29.669265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5c0d-efbb-4725-bcf9-3e10166569d6 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:29.669645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5c0d-efbb-4725-bcf9-3e10166569d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:29.680279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af5c0d-efbb-4725-bcf9-3e10166569d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:29.682328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af5c0d-efbb-4725-bcf9-3e10166569d6 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:29.694751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 658/1287] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:31.853675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052553e-36ad-4836-9f46-53ab1b3a9552 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:31.854348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052553e-36ad-4836-9f46-53ab1b3a9552 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:31.854348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052553e-36ad-4836-9f46-53ab1b3a9552 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:31.855990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 630/1288] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:31.864004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6ac71-11a7-4a09-8a6a-84ba22ea22f3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:31.864535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6ac71-11a7-4a09-8a6a-84ba22ea22f3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:31.864690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6ac71-11a7-4a09-8a6a-84ba22ea22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:31.885031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-bbc6ac71-11a7-4a09-8a6a-84ba22ea22f3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:31.886611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bbc6ac71-11a7-4a09-8a6a-84ba22ea22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:31.897014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 659/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:31.953835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052553e-36ad-4836-9f46-53ab1b3a9552 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:31.968010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052553e-36ad-4836-9f46-53ab1b3a9552 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:31.974027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f059cd9-182f-428c-bffc-ce90b95d4eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:31.974670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059cd9-182f-428c-bffc-ce90b95d4eeb service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:31.974959 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059cd9-182f-428c-bffc-ce90b95d4eeb service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:31.975244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f059cd9-182f-428c-bffc-ce90b95d4eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:31.983902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f059cd9-182f-428c-bffc-ce90b95d4eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:31.986106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f059cd9-182f-428c-bffc-ce90b95d4eeb service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:31.995604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 631/1290] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:34.598388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5abf7c-52b4-4751-a588-dfde179eea65 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:34.599167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5abf7c-52b4-4751-a588-dfde179eea65 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:34.599167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5abf7c-52b4-4751-a588-dfde179eea65 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:34.600706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 660/1291] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:18:34.608968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ef16-2888-46e0-8ff4-12bc58c9ea08 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:34.609430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ef16-2888-46e0-8ff4-12bc58c9ea08 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:34.609737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ef16-2888-46e0-8ff4-12bc58c9ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:34.629041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6e52ef16-2888-46e0-8ff4-12bc58c9ea08 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:34.630227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6e52ef16-2888-46e0-8ff4-12bc58c9ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:34.637964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 632/1292] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:34.684397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5abf7c-52b4-4751-a588-dfde179eea65 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:34.699432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5abf7c-52b4-4751-a588-dfde179eea65 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:34.705372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ca04-abd2-4ae3-8ccc-40b6c8a5cddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:34.711450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ca04-abd2-4ae3-8ccc-40b6c8a5cddb service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:34.711450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ca04-abd2-4ae3-8ccc-40b6c8a5cddb service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:34.711450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ca04-abd2-4ae3-8ccc-40b6c8a5cddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:34.717259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6ca04-abd2-4ae3-8ccc-40b6c8a5cddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:34.717259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6ca04-abd2-4ae3-8ccc-40b6c8a5cddb service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:34.726124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 661/1293] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:36.932885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7042d-3313-4def-b289-2ed1239b7fe3 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:36.933367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7042d-3313-4def-b289-2ed1239b7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:36.933463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7042d-3313-4def-b289-2ed1239b7fe3 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:36.935271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 633/1294] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:36.943259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32176-b540-4a7a-bbae-1364851c9413 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:36.943707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32176-b540-4a7a-bbae-1364851c9413 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:36.943809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32176-b540-4a7a-bbae-1364851c9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:36.961186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-40b32176-b540-4a7a-bbae-1364851c9413 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:36.962372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-40b32176-b540-4a7a-bbae-1364851c9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:36.970227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 662/1295] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:37.028837 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf58958-e4a3-4ae5-944d-d6f076b39f7d None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.029221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf58958-e4a3-4ae5-944d-d6f076b39f7d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.029565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf58958-e4a3-4ae5-944d-d6f076b39f7d None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.031462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 634/1296] 10.222.0.20 () {54 vars in 966 bytes} [Tue Sep 14 22:18:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:37.037426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.037719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.038004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.085746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] MFA Rules not processed for user `a78f380f9648428989c8f0bbf87921b1`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:37.086924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:37.100794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3865af5-28d7-40c6-810b-db3486ca8492 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.101118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3865af5-28d7-40c6-810b-db3486ca8492 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.101400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3865af5-28d7-40c6-810b-db3486ca8492 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.103159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 635/1297] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:37.110524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.110844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.111132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.129188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:37.130370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:37.138256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 636/1298] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:18:37.145626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 663/1299] 10.222.0.20 () {58 vars in 1064 bytes} [Tue Sep 14 22:18:37 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:18:37.153460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:37.162870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60af46-4dd1-4566-b6cd-b2b537b4dd00 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:37.166341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6359d2-cc8d-43ed-ad52-c90b505c7b28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:37.166963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6359d2-cc8d-43ed-ad52-c90b505c7b28 service glance] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.167246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6359d2-cc8d-43ed-ad52-c90b505c7b28 service glance] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.167522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6359d2-cc8d-43ed-ad52-c90b505c7b28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.176898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6359d2-cc8d-43ed-ad52-c90b505c7b28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:37.178317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6359d2-cc8d-43ed-ad52-c90b505c7b28 service glance] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:37.184337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:37.187624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 637/1300] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:37.196774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30cdd0-c5a6-4378-985b-5ee91ecd5b4a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:37.202393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c691214-8661-4149-8411-49f283184842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:37.203035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691214-8661-4149-8411-49f283184842 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.203319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691214-8661-4149-8411-49f283184842 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.203600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c691214-8661-4149-8411-49f283184842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.211652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c691214-8661-4149-8411-49f283184842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:37.213247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c691214-8661-4149-8411-49f283184842 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:37.222795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 664/1301] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:18:37.764980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d39e9-b9b3-40f9-b9bf-e7b24d3d345f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.765279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d39e9-b9b3-40f9-b9bf-e7b24d3d345f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.765565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d39e9-b9b3-40f9-b9bf-e7b24d3d345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.814186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3b0d39e9-b9b3-40f9-b9bf-e7b24d3d345f None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:37.815397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3b0d39e9-b9b3-40f9-b9bf-e7b24d3d345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:37.878578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 638/1302] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:18:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:37.923893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e81b15-4e42-45d1-893f-ac5233543e00 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.924192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e81b15-4e42-45d1-893f-ac5233543e00 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.924508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e81b15-4e42-45d1-893f-ac5233543e00 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.926293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 665/1303] 10.222.0.20 () {54 vars in 942 bytes} [Tue Sep 14 22:18:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:37.932810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd906d-2091-4eb7-9852-3a006d8896cf None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:37.933351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd906d-2091-4eb7-9852-3a006d8896cf None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:37.933907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd906d-2091-4eb7-9852-3a006d8896cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:37.981111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9dbd906d-2091-4eb7-9852-3a006d8896cf None None] MFA Rules not processed for user `e2ff32dae4784d4398bd57d5bd03aaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:37.982549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9dbd906d-2091-4eb7-9852-3a006d8896cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:38.059707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 639/1304] 10.222.0.20 () {58 vars in 1040 bytes} [Tue Sep 14 22:18:37 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:18:38.071171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e81b15-4e42-45d1-893f-ac5233543e00 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:38.085850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e81b15-4e42-45d1-893f-ac5233543e00 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:38.093895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bff74-9647-4215-b469-01af18b3a732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:38.094632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bff74-9647-4215-b469-01af18b3a732 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:38.094992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bff74-9647-4215-b469-01af18b3a732 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:38.095367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bff74-9647-4215-b469-01af18b3a732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:38.104292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bff74-9647-4215-b469-01af18b3a732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:38.106012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bff74-9647-4215-b469-01af18b3a732 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:38.115049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 666/1305] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:18:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 22:18:39.625061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b4a2-871c-4479-a0ee-d1020671237a None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:39.625654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b4a2-871c-4479-a0ee-d1020671237a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:39.625654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b4a2-871c-4479-a0ee-d1020671237a None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:39.627854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 640/1306] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:39.635386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f505c-552e-45f6-8b1a-f969610954a2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:39.635857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f505c-552e-45f6-8b1a-f969610954a2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:39.635949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f505c-552e-45f6-8b1a-f969610954a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:39.653587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1e7f505c-552e-45f6-8b1a-f969610954a2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:39.654831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1e7f505c-552e-45f6-8b1a-f969610954a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:39.663868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 667/1307] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:39.712524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658b4a2-871c-4479-a0ee-d1020671237a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:39.727919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658b4a2-871c-4479-a0ee-d1020671237a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:39.735532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376f90d-3e12-40f1-ba7c-1b849a98bd42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:39.736188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376f90d-3e12-40f1-ba7c-1b849a98bd42 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:39.736506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376f90d-3e12-40f1-ba7c-1b849a98bd42 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:39.736788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376f90d-3e12-40f1-ba7c-1b849a98bd42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:39.745373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376f90d-3e12-40f1-ba7c-1b849a98bd42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:39.746956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376f90d-3e12-40f1-ba7c-1b849a98bd42 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:39.767729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 641/1308] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:42.075914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e954-453c-40f7-9fd7-e8acdf33ecf7 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:42.076681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e954-453c-40f7-9fd7-e8acdf33ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:42.076681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e954-453c-40f7-9fd7-e8acdf33ecf7 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:42.078408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 668/1309] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:42.085550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8e6d3-1134-4a59-a354-64922eda5a2e None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:42.085995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8e6d3-1134-4a59-a354-64922eda5a2e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:42.086090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8e6d3-1134-4a59-a354-64922eda5a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:42.104130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e9f8e6d3-1134-4a59-a354-64922eda5a2e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:42.105352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e9f8e6d3-1134-4a59-a354-64922eda5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:42.114364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 642/1310] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:42.160572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033e954-453c-40f7-9fd7-e8acdf33ecf7 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:42.177525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033e954-453c-40f7-9fd7-e8acdf33ecf7 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:42.183695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5335-2d09-4ef1-9f4b-2e448a819470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:42.184407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5335-2d09-4ef1-9f4b-2e448a819470 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:42.184730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5335-2d09-4ef1-9f4b-2e448a819470 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:42.185012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5335-2d09-4ef1-9f4b-2e448a819470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:42.194953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe5335-2d09-4ef1-9f4b-2e448a819470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:42.196562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe5335-2d09-4ef1-9f4b-2e448a819470 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:42.209944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 669/1311] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:18:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:18:56.246708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb77d-f0c3-4f4e-9c4b-080239c96c27 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:56.247235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb77d-f0c3-4f4e-9c4b-080239c96c27 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:56.247235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb77d-f0c3-4f4e-9c4b-080239c96c27 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:56.249055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 643/1312] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:56.256695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae4c69-084b-4eeb-8967-cc97cba92048 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:56.257148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae4c69-084b-4eeb-8967-cc97cba92048 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:56.257288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae4c69-084b-4eeb-8967-cc97cba92048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:56.274545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-dfae4c69-084b-4eeb-8967-cc97cba92048 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:56.275736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-dfae4c69-084b-4eeb-8967-cc97cba92048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:56.283362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 670/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:56.307824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb77d-f0c3-4f4e-9c4b-080239c96c27 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:56.320576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb77d-f0c3-4f4e-9c4b-080239c96c27 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:56.325066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c49910-51ff-4a3e-b20a-507712380a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:56.325715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c49910-51ff-4a3e-b20a-507712380a40 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:56.326000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c49910-51ff-4a3e-b20a-507712380a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:56.326279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c49910-51ff-4a3e-b20a-507712380a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:56.327005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c49910-51ff-4a3e-b20a-507712380a40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:56.328879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c49910-51ff-4a3e-b20a-507712380a40 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:56.342077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 644/1314] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:18:56 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:18:58.479486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1925d3-e5ab-4c2b-99ef-e517154a5ef8 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:58.480085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1925d3-e5ab-4c2b-99ef-e517154a5ef8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:58.480085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1925d3-e5ab-4c2b-99ef-e517154a5ef8 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:58.481851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 671/1315] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:18:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:18:58.490051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:58.490465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:58.490570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:58.508775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:18:58.509961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:18:58.517631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 645/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:18:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:18:58.540756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1925d3-e5ab-4c2b-99ef-e517154a5ef8 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:58.553516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1925d3-e5ab-4c2b-99ef-e517154a5ef8 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:58.557923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:58.558746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:58.559027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:58.559307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] PATH_INFO: `/v3/projects/15970df938b34324ade5c0a6b2e46601` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:58.570175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] RBAC: Authorizing `identity:get_project(project_id=15970df938b34324ade5c0a6b2e46601)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:58.572217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:58.573987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 672/1317] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:18:58 2021] GET /identity/v3/projects/15970df938b34324ade5c0a6b2e46601 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:18:58.580294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:58.589327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7855c-5649-4d65-afc1-63ff663e3a95 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:58.593816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:58.594445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:58.594726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:58.594997 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:58.595754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] RBAC: Adding query filter params (scope.project.id=15970df938b34324ade5c0a6b2e46601) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:18:58.596058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:58.597900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:58.605334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 646/1318] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:18:58 2021] GET /identity/v3/role_assignments?scope.project.id=15970df938b34324ade5c0a6b2e46601 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:18:58.612129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:58.621442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8debae9-08b7-46de-967f-43785cc63a66 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:58.626464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319b89-439d-4c6a-b9cd-4820281d5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:58.627293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319b89-439d-4c6a-b9cd-4820281d5385 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:58.627575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319b89-439d-4c6a-b9cd-4820281d5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:58.627850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319b89-439d-4c6a-b9cd-4820281d5385 admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:58.629034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319b89-439d-4c6a-b9cd-4820281d5385 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:58.630765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319b89-439d-4c6a-b9cd-4820281d5385 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:58.632287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 673/1319] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:18:58 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:18:58.638039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:18:58.648380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cfba-83b5-4802-9110-8e52d07ab8e1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:18:58.652913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8ba0-d630-4485-a661-f07ddea417cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:18:58.653755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8ba0-d630-4485-a661-f07ddea417cb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:18:58.654037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8ba0-d630-4485-a661-f07ddea417cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:18:58.654315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8ba0-d630-4485-a661-f07ddea417cb admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:18:58.667383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8ba0-d630-4485-a661-f07ddea417cb admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:18:58.669610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8ba0-d630-4485-a661-f07ddea417cb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:18:58.675363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 647/1320] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:18:58 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:00.871998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688569e-5d1c-4f6a-b811-8ef62d880943 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:00.872587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688569e-5d1c-4f6a-b811-8ef62d880943 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:00.872587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688569e-5d1c-4f6a-b811-8ef62d880943 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:00.874372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 674/1321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:00.881901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:00.882331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:00.882466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:00.899697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:00.900950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:00.908741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 648/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:00.933010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688569e-5d1c-4f6a-b811-8ef62d880943 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:00.945959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688569e-5d1c-4f6a-b811-8ef62d880943 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:00.950430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:00.951273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:00.951559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:00.951840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] PATH_INFO: `/v3/projects/28134749d4e040b88a7f85c383c201c7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:00.953036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] RBAC: Authorizing `identity:get_project(project_id=28134749d4e040b88a7f85c383c201c7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:00.954803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:00.956467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 675/1323] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:19:00 2021] GET /identity/v3/projects/28134749d4e040b88a7f85c383c201c7 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:00.963107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:00.972071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35d9f-0592-49b6-a8b0-2571f73ecb05 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:00.976622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:00.977376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:00.977660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:00.977936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:00.978696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] RBAC: Adding query filter params (scope.project.id=28134749d4e040b88a7f85c383c201c7) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:19:00.979004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:00.980911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1e08-6c81-4270-9c4e-42a57c12c43e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:00.989621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 649/1324] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:19:00 2021] GET /identity/v3/role_assignments?scope.project.id=28134749d4e040b88a7f85c383c201c7 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:00.993809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:01.004191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9a268-7507-45db-abf0-1116edee177f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:01.008852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3d465-7d37-4e58-a6df-61888b8b639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:01.009734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d465-7d37-4e58-a6df-61888b8b639c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:01.010019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d465-7d37-4e58-a6df-61888b8b639c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:01.010299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d465-7d37-4e58-a6df-61888b8b639c admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:01.011492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d465-7d37-4e58-a6df-61888b8b639c admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:01.013283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d465-7d37-4e58-a6df-61888b8b639c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:01.014859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 676/1325] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:00 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:03.161752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84e09-3f06-443a-a486-2eca3ac482a3 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:03.162308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84e09-3f06-443a-a486-2eca3ac482a3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:03.162308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84e09-3f06-443a-a486-2eca3ac482a3 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:03.164110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 650/1326] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:03.171256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:03.172178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:03.172364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:03.190203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:03.191321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:03.199064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 677/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:03.222551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f84e09-3f06-443a-a486-2eca3ac482a3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:03.235335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f84e09-3f06-443a-a486-2eca3ac482a3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:03.244441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:03.245329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:03.245612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:03.245886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] PATH_INFO: `/v3/projects/2fa0f9f83e164243a5099ad7faeebf70` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:03.257405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa0f9f83e164243a5099ad7faeebf70)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:03.259437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:03.261172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 651/1328] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:19:03 2021] GET /identity/v3/projects/2fa0f9f83e164243a5099ad7faeebf70 => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:03.268334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:03.277657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390bfc4-1972-4715-87ca-f4e119fcc9f2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:03.282943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:03.283622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:03.283913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:03.284196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:03.285008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] RBAC: Adding query filter params (scope.project.id=2fa0f9f83e164243a5099ad7faeebf70) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:19:03.285322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:03.287151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:03.293864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 678/1329] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:19:03 2021] GET /identity/v3/role_assignments?scope.project.id=2fa0f9f83e164243a5099ad7faeebf70 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:19:03.299981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:03.309618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fb5c-6b59-49a7-af2c-856b23afa039 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:03.314213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a46d4-3fba-442e-8553-bde63ae177ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:03.315062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a46d4-3fba-442e-8553-bde63ae177ca admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:03.315352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a46d4-3fba-442e-8553-bde63ae177ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:03.315632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a46d4-3fba-442e-8553-bde63ae177ca admin admin] PATH_INFO: `/v3/users/f75e42666c5647d2b9264e3dd0aafbf1` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:03.329223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a46d4-3fba-442e-8553-bde63ae177ca admin admin] RBAC: Authorizing `identity:get_user(user_id=f75e42666c5647d2b9264e3dd0aafbf1)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:03.331393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a46d4-3fba-442e-8553-bde63ae177ca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:03.333070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 652/1330] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:03 2021] GET /identity/v3/users/f75e42666c5647d2b9264e3dd0aafbf1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:03.339318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:03.349460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b3a1-eb61-4bad-b3bb-b1df7bcabf72 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:03.354038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c89f9f-2927-437f-8926-ddd5d0f1d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:03.354903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c89f9f-2927-437f-8926-ddd5d0f1d33c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:03.355195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c89f9f-2927-437f-8926-ddd5d0f1d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:03.355478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c89f9f-2927-437f-8926-ddd5d0f1d33c admin admin] PATH_INFO: `/v3/users/29d17efac01a47f69d2962f6181b8618` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:03.369039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c89f9f-2927-437f-8926-ddd5d0f1d33c admin admin] RBAC: Authorizing `identity:get_user(user_id=29d17efac01a47f69d2962f6181b8618)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:03.371141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c89f9f-2927-437f-8926-ddd5d0f1d33c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:03.372859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 679/1331] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:03 2021] GET /identity/v3/users/29d17efac01a47f69d2962f6181b8618 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:05.593951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9351-13dd-419e-9db1-02eb1d5541b0 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:05.594506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9351-13dd-419e-9db1-02eb1d5541b0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:05.594619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9351-13dd-419e-9db1-02eb1d5541b0 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:05.596312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 653/1332] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:05.603374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636ef1-5c08-463d-8848-934b46244887 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:05.603805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636ef1-5c08-463d-8848-934b46244887 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:05.603943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636ef1-5c08-463d-8848-934b46244887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:05.621692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-88636ef1-5c08-463d-8848-934b46244887 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:05.622875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-88636ef1-5c08-463d-8848-934b46244887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:05.630590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 680/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:05.653932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9351-13dd-419e-9db1-02eb1d5541b0 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:05.666689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9351-13dd-419e-9db1-02eb1d5541b0 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:05.672091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:05.672953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:05.673238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:05.673511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] PATH_INFO: `/v3/projects/698f287bc6964263ac5a9264981d29cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:05.684077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] RBAC: Authorizing `identity:get_project(project_id=698f287bc6964263ac5a9264981d29cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:05.686206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:05.687933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 654/1334] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:19:05 2021] GET /identity/v3/projects/698f287bc6964263ac5a9264981d29cc => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:05.694567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88636ef1-5c08-463d-8848-934b46244887 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:05.703494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88636ef1-5c08-463d-8848-934b46244887 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:05.708152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:05.708839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:05.709128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:05.709441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:05.710207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] RBAC: Adding query filter params (scope.project.id=698f287bc6964263ac5a9264981d29cc) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:19:05.710517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:05.712345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:05.719399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 681/1335] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:19:05 2021] GET /identity/v3/role_assignments?scope.project.id=698f287bc6964263ac5a9264981d29cc => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:19:05.725451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:05.735843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcd2d1-273e-4253-8523-e8514a81d226 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:05.740557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a80d25-42cf-4140-aab9-81be3aee354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:05.741394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a80d25-42cf-4140-aab9-81be3aee354b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:05.741681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a80d25-42cf-4140-aab9-81be3aee354b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:05.741963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a80d25-42cf-4140-aab9-81be3aee354b admin admin] PATH_INFO: `/v3/users/ff904f2428954da5908fbaf5fc605dce` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:05.743123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a80d25-42cf-4140-aab9-81be3aee354b admin admin] RBAC: Authorizing `identity:get_user(user_id=ff904f2428954da5908fbaf5fc605dce)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:05.744931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a80d25-42cf-4140-aab9-81be3aee354b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:05.746500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 655/1336] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:05 2021] GET /identity/v3/users/ff904f2428954da5908fbaf5fc605dce => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:05.753011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:05.762456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e62f21-9a19-4f7b-bae9-f1af24176787 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:05.767787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200d1e-a600-484e-8435-63d4aa493b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:05.768687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200d1e-a600-484e-8435-63d4aa493b46 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:05.768978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200d1e-a600-484e-8435-63d4aa493b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:05.769261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200d1e-a600-484e-8435-63d4aa493b46 admin admin] PATH_INFO: `/v3/users/c9ae58b4092f431d9920763647a309c7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:05.782341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200d1e-a600-484e-8435-63d4aa493b46 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9ae58b4092f431d9920763647a309c7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:05.784525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200d1e-a600-484e-8435-63d4aa493b46 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:05.786138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 682/1337] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:05 2021] GET /identity/v3/users/c9ae58b4092f431d9920763647a309c7 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:07.996360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df89c-67fa-440e-994c-45521f535fc2 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:07.996947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df89c-67fa-440e-994c-45521f535fc2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:07.996947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df89c-67fa-440e-994c-45521f535fc2 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:07.998729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 656/1338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:08.005972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:08.006389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:08.006543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:08.023712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:08.024936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:08.033163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 683/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:08.057604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df89c-67fa-440e-994c-45521f535fc2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:08.069509 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df89c-67fa-440e-994c-45521f535fc2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:08.074133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:08.074969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:08.075255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:08.075533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] PATH_INFO: `/v3/projects/d3ada4becfc745a397563ae630275ae5` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:08.086413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3ada4becfc745a397563ae630275ae5)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:08.088487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:08.090157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 657/1340] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:19:08 2021] GET /identity/v3/projects/d3ada4becfc745a397563ae630275ae5 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:08.096878 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:08.105582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d5bdd-3d47-4844-80fd-d5e5ec14a14a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:08.110969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:08.111605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:08.111893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:08.112173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:08.112965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] RBAC: Adding query filter params (scope.project.id=d3ada4becfc745a397563ae630275ae5) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:19:08.113279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:08.115091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50d9f3-0470-43d3-a590-f8f3c6681c99 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:08.120292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 684/1341] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:19:08 2021] GET /identity/v3/role_assignments?scope.project.id=d3ada4becfc745a397563ae630275ae5 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:08.126213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:08.135545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73f1b-46d3-45d1-b802-237a18033292 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:08.139993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2d46c-5341-4cf7-9925-1c596dbb00e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:08.140867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2d46c-5341-4cf7-9925-1c596dbb00e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:08.141151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2d46c-5341-4cf7-9925-1c596dbb00e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:08.141428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2d46c-5341-4cf7-9925-1c596dbb00e1 admin admin] PATH_INFO: `/v3/users/d8a2cbb71af5415fbc0155ea80966290` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:08.154918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2d46c-5341-4cf7-9925-1c596dbb00e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8a2cbb71af5415fbc0155ea80966290)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:08.157558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2d46c-5341-4cf7-9925-1c596dbb00e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:08.159133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 658/1342] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:08 2021] GET /identity/v3/users/d8a2cbb71af5415fbc0155ea80966290 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:10.366971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5b41-0141-4e87-8670-b0bce986cd92 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:10.367547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5b41-0141-4e87-8670-b0bce986cd92 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:10.367547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5b41-0141-4e87-8670-b0bce986cd92 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:10.369380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 685/1343] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:10.376786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:10.377237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:10.377333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:10.395511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:10.396765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:10.404517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 659/1344] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:10.428148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e5b41-0141-4e87-8670-b0bce986cd92 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:10.440849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e5b41-0141-4e87-8670-b0bce986cd92 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:10.445400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:10.446273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:10.446562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:10.446841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] PATH_INFO: `/v3/projects/e4769bc444274e8586e4a57e7480ac20` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:10.458232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4769bc444274e8586e4a57e7480ac20)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:10.460319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:10.462022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 686/1345] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:19:10 2021] GET /identity/v3/projects/e4769bc444274e8586e4a57e7480ac20 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:10.468267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:10.477280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4705f3-0442-41e0-92e5-9743f8d528b4 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:10.481753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:10.482642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:10.482923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:10.483197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:10.484492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] RBAC: Adding query filter params (scope.project.id=e4769bc444274e8586e4a57e7480ac20) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:19:10.484800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:10.486607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ba8f3-b4db-4ae5-9015-d6f60cbf8be1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:10.491884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 660/1346] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:19:10 2021] GET /identity/v3/role_assignments?scope.project.id=e4769bc444274e8586e4a57e7480ac20 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:10.497724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:10.507599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f1e8-1c9c-4ae4-a2c5-01cb64bf22d3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:10.512062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18ed5f-0f18-47ef-960d-7a7fc4a0d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:10.512933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18ed5f-0f18-47ef-960d-7a7fc4a0d584 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:10.513220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18ed5f-0f18-47ef-960d-7a7fc4a0d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:10.513493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18ed5f-0f18-47ef-960d-7a7fc4a0d584 admin admin] PATH_INFO: `/v3/users/2acd590566f84548b72e8db4e6dd1038` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:10.514653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18ed5f-0f18-47ef-960d-7a7fc4a0d584 admin admin] RBAC: Authorizing `identity:get_user(user_id=2acd590566f84548b72e8db4e6dd1038)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:10.516751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18ed5f-0f18-47ef-960d-7a7fc4a0d584 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:10.518281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 687/1347] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:10 2021] GET /identity/v3/users/2acd590566f84548b72e8db4e6dd1038 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:19:12.711431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21921db-e004-456c-8a16-604f48b2d82e None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:12.711971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21921db-e004-456c-8a16-604f48b2d82e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:12.711971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21921db-e004-456c-8a16-604f48b2d82e None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:12.713782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 661/1348] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:12.720945 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:12.721406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:12.721499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:12.739782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:12.744738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:12.748942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 688/1349] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:12.772838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21921db-e004-456c-8a16-604f48b2d82e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:12.785046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21921db-e004-456c-8a16-604f48b2d82e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:12.789461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:12.790298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:12.790609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:12.790892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] PATH_INFO: `/v3/projects/e8367ff1a1294a3e98c7515a9407948d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:12.801668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] RBAC: Authorizing `identity:get_project(project_id=e8367ff1a1294a3e98c7515a9407948d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:12.803707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:12.805412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 662/1350] 10.222.0.20 () {56 vars in 1208 bytes} [Tue Sep 14 22:19:12 2021] GET /identity/v3/projects/e8367ff1a1294a3e98c7515a9407948d => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:12.812715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:12.821714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1bf0d-6b97-495f-a614-50541ef280b3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:12.826329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:12.826970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:12.827260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:12.827544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:12.828308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] RBAC: Adding query filter params (scope.project.id=e8367ff1a1294a3e98c7515a9407948d) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:19:12.828657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:12.830516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b74ce-5b8c-4f8b-885d-bb345369df97 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:12.835793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 689/1351] 10.222.0.20 () {56 vars in 1232 bytes} [Tue Sep 14 22:19:12 2021] GET /identity/v3/role_assignments?scope.project.id=e8367ff1a1294a3e98c7515a9407948d => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:12.841760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:12.851592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e99117-e4b7-48b5-93b3-e9043e74567c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:12.856133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43e58-0081-43c8-a5b8-f94961601770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:12.857266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43e58-0081-43c8-a5b8-f94961601770 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:12.857549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43e58-0081-43c8-a5b8-f94961601770 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:12.857825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43e58-0081-43c8-a5b8-f94961601770 admin admin] PATH_INFO: `/v3/users/11f83508335c473fad195a694c609a23` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:12.871660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43e58-0081-43c8-a5b8-f94961601770 admin admin] RBAC: Authorizing `identity:get_user(user_id=11f83508335c473fad195a694c609a23)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:12.873817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43e58-0081-43c8-a5b8-f94961601770 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:12.876092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 663/1352] 10.222.0.20 () {56 vars in 1199 bytes} [Tue Sep 14 22:19:12 2021] GET /identity/v3/users/11f83508335c473fad195a694c609a23 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:19:18.093262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3213fb-24c2-4290-a0df-ce2f9a694c8c None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:18.093876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3213fb-24c2-4290-a0df-ce2f9a694c8c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:18.093876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3213fb-24c2-4290-a0df-ce2f9a694c8c None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:18.095642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 690/1353] 10.222.0.20 () {54 vars in 918 bytes} [Tue Sep 14 22:19:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:18.101463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3e95-905d-4547-9ab7-20f6055b7e1d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:18.101876 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3e95-905d-4547-9ab7-20f6055b7e1d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:18.102050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3e95-905d-4547-9ab7-20f6055b7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:18.120487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-890f3e95-905d-4547-9ab7-20f6055b7e1d None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:18.121673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-890f3e95-905d-4547-9ab7-20f6055b7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:18.130715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 664/1354] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 14 22:19:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:18.145376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a384a-c3af-408f-b3e0-56d543c0186d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:18.145670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a384a-c3af-408f-b3e0-56d543c0186d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:18.145953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a384a-c3af-408f-b3e0-56d543c0186d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:18.147681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 691/1355] 10.222.0.20 () {54 vars in 918 bytes} [Tue Sep 14 22:19:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:18.152589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666815-254e-48be-a7b6-0dbfc3568637 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:18.152875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666815-254e-48be-a7b6-0dbfc3568637 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:18.153150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666815-254e-48be-a7b6-0dbfc3568637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:18.170123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8a666815-254e-48be-a7b6-0dbfc3568637 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:18.171798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8a666815-254e-48be-a7b6-0dbfc3568637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:18.180681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 665/1356] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Sep 14 22:19:18 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:21.027632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8004f7-402d-4fa7-990a-02b4f38a9aae None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:21.028208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8004f7-402d-4fa7-990a-02b4f38a9aae None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:21.028208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8004f7-402d-4fa7-990a-02b4f38a9aae None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:21.029992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 692/1357] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:21.037299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff6974-0c0f-49f8-9ae4-51ca9284233f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:21.037731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff6974-0c0f-49f8-9ae4-51ca9284233f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:21.037874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff6974-0c0f-49f8-9ae4-51ca9284233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:21.055793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-eaff6974-0c0f-49f8-9ae4-51ca9284233f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:21.057044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-eaff6974-0c0f-49f8-9ae4-51ca9284233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:21.065319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 666/1358] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:21.108967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8004f7-402d-4fa7-990a-02b4f38a9aae None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:21.122699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8004f7-402d-4fa7-990a-02b4f38a9aae None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:21.128690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc7e4-c326-463e-a35f-422af70dd8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:21.129327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc7e4-c326-463e-a35f-422af70dd8c1 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:21.129613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc7e4-c326-463e-a35f-422af70dd8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:21.129891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc7e4-c326-463e-a35f-422af70dd8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:21.137626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc7e4-c326-463e-a35f-422af70dd8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:21.139170 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc7e4-c326-463e-a35f-422af70dd8c1 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:21.148304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 693/1359] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:22.533879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51b73b-9ef3-48e4-ab33-8748c65e844e None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:22.534414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51b73b-9ef3-48e4-ab33-8748c65e844e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:22.534414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51b73b-9ef3-48e4-ab33-8748c65e844e None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:22.536106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 667/1360] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:22.541517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de31b-f47c-4aaf-8dcb-26e7e7b1387b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:22.541937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de31b-f47c-4aaf-8dcb-26e7e7b1387b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:22.542128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de31b-f47c-4aaf-8dcb-26e7e7b1387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:22.559851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8b9de31b-f47c-4aaf-8dcb-26e7e7b1387b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:22.561082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8b9de31b-f47c-4aaf-8dcb-26e7e7b1387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:22.568605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 694/1361] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:19:22.718723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51b73b-9ef3-48e4-ab33-8748c65e844e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:22.732787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51b73b-9ef3-48e4-ab33-8748c65e844e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:22.738030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7f4d9-aacd-42aa-ac02-a978b9780662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:22.738655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7f4d9-aacd-42aa-ac02-a978b9780662 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:22.738936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7f4d9-aacd-42aa-ac02-a978b9780662 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:22.739210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7f4d9-aacd-42aa-ac02-a978b9780662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:22.746972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7f4d9-aacd-42aa-ac02-a978b9780662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:22.748561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7f4d9-aacd-42aa-ac02-a978b9780662 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:22.757475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 668/1362] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:24.147087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f20a6-eef7-4c63-a8f5-98f35e6d22d0 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:24.147674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f20a6-eef7-4c63-a8f5-98f35e6d22d0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:24.147674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f20a6-eef7-4c63-a8f5-98f35e6d22d0 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:24.149475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 695/1363] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:24.154949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fe877-6293-4646-9f6e-ac94ecade729 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:24.155366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fe877-6293-4646-9f6e-ac94ecade729 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:24.155613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fe877-6293-4646-9f6e-ac94ecade729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:24.173649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f58fe877-6293-4646-9f6e-ac94ecade729 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:24.174839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f58fe877-6293-4646-9f6e-ac94ecade729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:24.182817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 669/1364] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:24.333312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f20a6-eef7-4c63-a8f5-98f35e6d22d0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:24.348198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f20a6-eef7-4c63-a8f5-98f35e6d22d0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:24.353597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecddce-da3c-43a7-ad8d-8aa16e23385c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:24.354236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecddce-da3c-43a7-ad8d-8aa16e23385c service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:24.354525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecddce-da3c-43a7-ad8d-8aa16e23385c service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:24.354807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecddce-da3c-43a7-ad8d-8aa16e23385c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:24.363530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecddce-da3c-43a7-ad8d-8aa16e23385c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:24.365148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecddce-da3c-43a7-ad8d-8aa16e23385c service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:24.374770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 696/1365] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:25.807472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c1582-b46c-4973-93ba-5b950c034fd1 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:25.808070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c1582-b46c-4973-93ba-5b950c034fd1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:25.808070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c1582-b46c-4973-93ba-5b950c034fd1 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:25.809810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 670/1366] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:25.815925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a02c0-6383-4839-8db6-1f8e68405479 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:25.816389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a02c0-6383-4839-8db6-1f8e68405479 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:25.816506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a02c0-6383-4839-8db6-1f8e68405479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:25.834271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3b2a02c0-6383-4839-8db6-1f8e68405479 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:25.835459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3b2a02c0-6383-4839-8db6-1f8e68405479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:25.843709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 697/1367] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:25.995931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c1582-b46c-4973-93ba-5b950c034fd1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:26.010077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c1582-b46c-4973-93ba-5b950c034fd1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:26.015472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646bc17-4882-40b3-9377-a9f65814f3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:26.016103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646bc17-4882-40b3-9377-a9f65814f3dc service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:26.016427 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646bc17-4882-40b3-9377-a9f65814f3dc service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:26.016721 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646bc17-4882-40b3-9377-a9f65814f3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:26.024616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646bc17-4882-40b3-9377-a9f65814f3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:26.026182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646bc17-4882-40b3-9377-a9f65814f3dc service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:26.036058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 671/1368] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:27.406990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d52f62-ea28-4de3-b69d-1dd3b69b6102 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:27.407541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d52f62-ea28-4de3-b69d-1dd3b69b6102 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:27.407541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d52f62-ea28-4de3-b69d-1dd3b69b6102 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:27.409485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 698/1369] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:27.415019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce530bee-300f-4875-8360-36ce551c35ce None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:27.415490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce530bee-300f-4875-8360-36ce551c35ce None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:27.415588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce530bee-300f-4875-8360-36ce551c35ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:27.432847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ce530bee-300f-4875-8360-36ce551c35ce None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:27.434028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ce530bee-300f-4875-8360-36ce551c35ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:27.442193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 672/1370] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:27.594413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d52f62-ea28-4de3-b69d-1dd3b69b6102 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:27.608748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d52f62-ea28-4de3-b69d-1dd3b69b6102 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:27.614179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75605b34-16b5-4256-adce-e2058dfee7da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:27.614821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605b34-16b5-4256-adce-e2058dfee7da service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:27.615108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605b34-16b5-4256-adce-e2058dfee7da service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:27.615390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605b34-16b5-4256-adce-e2058dfee7da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:27.623801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75605b34-16b5-4256-adce-e2058dfee7da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:27.625409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75605b34-16b5-4256-adce-e2058dfee7da service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:27.634737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 699/1371] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:29.048137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e0bd-3314-4ece-b053-cd9003314ac6 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:29.048740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e0bd-3314-4ece-b053-cd9003314ac6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:29.048740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e0bd-3314-4ece-b053-cd9003314ac6 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:29.050488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 673/1372] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:29.056149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097d08-cb80-48d9-9e20-9b5de4825f38 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:29.056567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097d08-cb80-48d9-9e20-9b5de4825f38 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:29.056738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097d08-cb80-48d9-9e20-9b5de4825f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:29.073807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1f097d08-cb80-48d9-9e20-9b5de4825f38 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:29.074976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1f097d08-cb80-48d9-9e20-9b5de4825f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:29.082546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 700/1373] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:29.235248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247e0bd-3314-4ece-b053-cd9003314ac6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:29.249970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247e0bd-3314-4ece-b053-cd9003314ac6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:29.255280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f9fb3-fab2-45bf-918b-4fc88934c7c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:29.255920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f9fb3-fab2-45bf-918b-4fc88934c7c6 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:29.256205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f9fb3-fab2-45bf-918b-4fc88934c7c6 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:29.256518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f9fb3-fab2-45bf-918b-4fc88934c7c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:29.268499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f9fb3-fab2-45bf-918b-4fc88934c7c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:29.270067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f9fb3-fab2-45bf-918b-4fc88934c7c6 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:29.279305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 674/1374] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:30.672307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca2e9-a624-482f-96a4-58e740f7f4fb None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:30.678911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca2e9-a624-482f-96a4-58e740f7f4fb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:30.678911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca2e9-a624-482f-96a4-58e740f7f4fb None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:30.678911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 701/1375] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:19:30.680065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71873b-a3c5-4331-9fb9-94cb1742cb2b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:30.680468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71873b-a3c5-4331-9fb9-94cb1742cb2b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:30.680663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71873b-a3c5-4331-9fb9-94cb1742cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:30.698217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3d71873b-a3c5-4331-9fb9-94cb1742cb2b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:30.699383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3d71873b-a3c5-4331-9fb9-94cb1742cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:30.707592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 675/1376] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:30.858060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca2e9-a624-482f-96a4-58e740f7f4fb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:30.871953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca2e9-a624-482f-96a4-58e740f7f4fb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:30.877305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cffb3-9940-4135-a23f-4b4536fc97ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:30.877941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cffb3-9940-4135-a23f-4b4536fc97ca service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:30.878231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cffb3-9940-4135-a23f-4b4536fc97ca service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:30.878514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cffb3-9940-4135-a23f-4b4536fc97ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:30.886280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cffb3-9940-4135-a23f-4b4536fc97ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:30.887859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cffb3-9940-4135-a23f-4b4536fc97ca service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:30.897504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 702/1377] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:32.339415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba964-4063-4245-ad7f-9926a17d0c4f None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:32.339983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba964-4063-4245-ad7f-9926a17d0c4f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:32.339983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba964-4063-4245-ad7f-9926a17d0c4f None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:32.341796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 676/1378] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:32.347728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ae29-72bd-4f66-a5aa-16d8dc88451b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:32.348180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ae29-72bd-4f66-a5aa-16d8dc88451b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:32.348353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ae29-72bd-4f66-a5aa-16d8dc88451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:32.366970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-bc47ae29-72bd-4f66-a5aa-16d8dc88451b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:32.368161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bc47ae29-72bd-4f66-a5aa-16d8dc88451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:32.376040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 703/1379] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:32.527385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bba964-4063-4245-ad7f-9926a17d0c4f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:32.541652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bba964-4063-4245-ad7f-9926a17d0c4f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:32.546965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe33b-d121-42f1-b973-97c67c4fb5b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:32.547592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe33b-d121-42f1-b973-97c67c4fb5b5 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:32.547872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe33b-d121-42f1-b973-97c67c4fb5b5 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:32.548147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe33b-d121-42f1-b973-97c67c4fb5b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:32.555871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe33b-d121-42f1-b973-97c67c4fb5b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:32.557525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe33b-d121-42f1-b973-97c67c4fb5b5 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:32.566582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 677/1380] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:33.932926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9f74-0933-4b97-972c-d6b1536a52d2 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:33.933496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9f74-0933-4b97-972c-d6b1536a52d2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:33.933496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9f74-0933-4b97-972c-d6b1536a52d2 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:33.935245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 704/1381] 10.222.0.20 () {54 vars in 911 bytes} [Tue Sep 14 22:19:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:33.940725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60ce2-0f0f-4c9d-9041-d250c3361914 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:33.941124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60ce2-0f0f-4c9d-9041-d250c3361914 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:33.941296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60ce2-0f0f-4c9d-9041-d250c3361914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:33.959155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b6f60ce2-0f0f-4c9d-9041-d250c3361914 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:33.960328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b6f60ce2-0f0f-4c9d-9041-d250c3361914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:33.968694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 678/1382] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 14 22:19:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:34.120153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9f74-0933-4b97-972c-d6b1536a52d2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:34.134496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9f74-0933-4b97-972c-d6b1536a52d2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:34.140342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6e91-5852-4535-83d7-abcee48f9b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:34.141018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6e91-5852-4535-83d7-abcee48f9b44 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:34.141306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6e91-5852-4535-83d7-abcee48f9b44 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:34.141589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6e91-5852-4535-83d7-abcee48f9b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:34.149383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6e91-5852-4535-83d7-abcee48f9b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:34.150950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6e91-5852-4535-83d7-abcee48f9b44 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:34.159913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 705/1383] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:36.236825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e9cac-fa5e-4e43-9b82-c1f2ecd9896a None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:36.237367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e9cac-fa5e-4e43-9b82-c1f2ecd9896a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:36.237367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e9cac-fa5e-4e43-9b82-c1f2ecd9896a None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:36.239157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 679/1384] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:36.246724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617515c0-ee3e-43a2-8f25-fc3669f164a4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:36.247186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617515c0-ee3e-43a2-8f25-fc3669f164a4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:36.247286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617515c0-ee3e-43a2-8f25-fc3669f164a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:36.264915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-617515c0-ee3e-43a2-8f25-fc3669f164a4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:36.266101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-617515c0-ee3e-43a2-8f25-fc3669f164a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:36.273661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 706/1385] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:36.313232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e9cac-fa5e-4e43-9b82-c1f2ecd9896a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:36.323515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e9cac-fa5e-4e43-9b82-c1f2ecd9896a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:36.327472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dec70-1fb1-4f63-97a1-c0fc601b9faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:36.328097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dec70-1fb1-4f63-97a1-c0fc601b9faf service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:36.328379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dec70-1fb1-4f63-97a1-c0fc601b9faf service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:36.328685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dec70-1fb1-4f63-97a1-c0fc601b9faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:36.337294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38dec70-1fb1-4f63-97a1-c0fc601b9faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:36.338703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38dec70-1fb1-4f63-97a1-c0fc601b9faf service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:36.348330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 680/1386] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:38.636701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6278-36d6-48e8-9d22-c69a9ef9423c None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:38.637279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6278-36d6-48e8-9d22-c69a9ef9423c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:38.637279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6278-36d6-48e8-9d22-c69a9ef9423c None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:38.639093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 707/1387] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:38.646183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad545f04-daa8-426a-9cb8-a6391d496974 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:38.646586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad545f04-daa8-426a-9cb8-a6391d496974 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:38.646768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad545f04-daa8-426a-9cb8-a6391d496974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:38.664505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ad545f04-daa8-426a-9cb8-a6391d496974 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:38.665689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ad545f04-daa8-426a-9cb8-a6391d496974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:38.674500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 681/1388] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:38.712276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6278-36d6-48e8-9d22-c69a9ef9423c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:38.723484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6278-36d6-48e8-9d22-c69a9ef9423c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:38.727034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553fbb1-7ec3-4291-b3a4-9bcb7a994e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:38.727673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553fbb1-7ec3-4291-b3a4-9bcb7a994e5d service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:38.727955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553fbb1-7ec3-4291-b3a4-9bcb7a994e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:38.728230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553fbb1-7ec3-4291-b3a4-9bcb7a994e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:38.737772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553fbb1-7ec3-4291-b3a4-9bcb7a994e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:38.739186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553fbb1-7ec3-4291-b3a4-9bcb7a994e5d service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:38.748841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 708/1389] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:41.288107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f159bd-52b0-4912-9450-c56893db866b None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:41.288655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f159bd-52b0-4912-9450-c56893db866b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:41.288774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f159bd-52b0-4912-9450-c56893db866b None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:41.290516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 682/1390] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:41.298273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256db80-68f6-4df6-8f67-b51e80d07bc7 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:41.298725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256db80-68f6-4df6-8f67-b51e80d07bc7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:41.298846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256db80-68f6-4df6-8f67-b51e80d07bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:41.316533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4256db80-68f6-4df6-8f67-b51e80d07bc7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:41.317721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4256db80-68f6-4df6-8f67-b51e80d07bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:41.325300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 709/1391] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:41.364544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f159bd-52b0-4912-9450-c56893db866b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:41.375472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f159bd-52b0-4912-9450-c56893db866b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:41.378965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a801a4-a081-43c1-bf1f-dd9e635bc659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:41.379590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a801a4-a081-43c1-bf1f-dd9e635bc659 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:41.379867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a801a4-a081-43c1-bf1f-dd9e635bc659 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:41.380143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a801a4-a081-43c1-bf1f-dd9e635bc659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:41.388688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a801a4-a081-43c1-bf1f-dd9e635bc659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:41.390099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a801a4-a081-43c1-bf1f-dd9e635bc659 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:41.399048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 683/1392] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:43.668908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc26ef-91b3-49a6-97f9-9514cfb076f9 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:43.669444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc26ef-91b3-49a6-97f9-9514cfb076f9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:43.669551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc26ef-91b3-49a6-97f9-9514cfb076f9 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:43.672089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 710/1393] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:43.679847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d067-f848-45cf-af08-57d44aec61f4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:43.680273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d067-f848-45cf-af08-57d44aec61f4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:43.680410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d067-f848-45cf-af08-57d44aec61f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:43.697691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e429d067-f848-45cf-af08-57d44aec61f4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:43.698863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e429d067-f848-45cf-af08-57d44aec61f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:43.706996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 684/1394] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:43.747180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc26ef-91b3-49a6-97f9-9514cfb076f9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:43.757521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc26ef-91b3-49a6-97f9-9514cfb076f9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:43.762106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d34ef-0a9a-44f6-b996-3b66ca249f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:43.762106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d34ef-0a9a-44f6-b996-3b66ca249f2d service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:43.762106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d34ef-0a9a-44f6-b996-3b66ca249f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:43.762106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d34ef-0a9a-44f6-b996-3b66ca249f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:43.771124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d34ef-0a9a-44f6-b996-3b66ca249f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:43.772554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d34ef-0a9a-44f6-b996-3b66ca249f2d service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:43.782032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 711/1395] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:19:46.034177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973c42-919c-4f99-9772-132f7f01e236 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:46.037574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973c42-919c-4f99-9772-132f7f01e236 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:46.037574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973c42-919c-4f99-9772-132f7f01e236 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:46.037574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 685/1396] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:46.043643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28095d5-90e3-4838-9a4d-f97af44e5920 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:46.044064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28095d5-90e3-4838-9a4d-f97af44e5920 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:46.044207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28095d5-90e3-4838-9a4d-f97af44e5920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:46.062751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a28095d5-90e3-4838-9a4d-f97af44e5920 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:46.063937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a28095d5-90e3-4838-9a4d-f97af44e5920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:46.071637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 712/1397] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:19:46.111401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973c42-919c-4f99-9772-132f7f01e236 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:46.123810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973c42-919c-4f99-9772-132f7f01e236 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:46.127985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed805eb-4710-43f4-bcfa-7fbe863f62fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:46.128693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed805eb-4710-43f4-bcfa-7fbe863f62fc service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:46.128969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed805eb-4710-43f4-bcfa-7fbe863f62fc service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:46.129238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed805eb-4710-43f4-bcfa-7fbe863f62fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:46.137758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed805eb-4710-43f4-bcfa-7fbe863f62fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:46.139167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed805eb-4710-43f4-bcfa-7fbe863f62fc service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:46.148131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 686/1398] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:48.342610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb0ac-27a6-46a8-a3c9-d815a4d7a648 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:48.343184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb0ac-27a6-46a8-a3c9-d815a4d7a648 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:48.343184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb0ac-27a6-46a8-a3c9-d815a4d7a648 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:48.345052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 713/1399] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:48.352071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac083f-1a03-4292-b50e-80a892bf5739 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:48.352547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac083f-1a03-4292-b50e-80a892bf5739 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:48.352659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac083f-1a03-4292-b50e-80a892bf5739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:48.371494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-95ac083f-1a03-4292-b50e-80a892bf5739 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:48.372715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-95ac083f-1a03-4292-b50e-80a892bf5739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:48.380351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 687/1400] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:48.419135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acb0ac-27a6-46a8-a3c9-d815a4d7a648 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:48.430187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acb0ac-27a6-46a8-a3c9-d815a4d7a648 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:48.433681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776083fa-14db-490b-b997-3348610725e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:48.434310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776083fa-14db-490b-b997-3348610725e8 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:48.434590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776083fa-14db-490b-b997-3348610725e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:48.434865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776083fa-14db-490b-b997-3348610725e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:48.443437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776083fa-14db-490b-b997-3348610725e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:48.444885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776083fa-14db-490b-b997-3348610725e8 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:48.453804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 714/1401] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:50.679411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521e9d6-2513-41d4-a426-7adfad788255 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:50.679996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521e9d6-2513-41d4-a426-7adfad788255 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:50.679996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521e9d6-2513-41d4-a426-7adfad788255 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:50.681796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 688/1402] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:50.689401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65923d69-5e62-4472-bae9-f096649f737a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:50.689863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65923d69-5e62-4472-bae9-f096649f737a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:50.689999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65923d69-5e62-4472-bae9-f096649f737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:50.707774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-65923d69-5e62-4472-bae9-f096649f737a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:50.708974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-65923d69-5e62-4472-bae9-f096649f737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:50.716552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 715/1403] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:19:50.755216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521e9d6-2513-41d4-a426-7adfad788255 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:50.766405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521e9d6-2513-41d4-a426-7adfad788255 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:50.769961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ae6ec-dc74-495a-a55d-beec9c33abc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:50.770595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ae6ec-dc74-495a-a55d-beec9c33abc9 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:50.770878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ae6ec-dc74-495a-a55d-beec9c33abc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:50.771182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ae6ec-dc74-495a-a55d-beec9c33abc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:50.779897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ae6ec-dc74-495a-a55d-beec9c33abc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:50.781341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ae6ec-dc74-495a-a55d-beec9c33abc9 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:50.790403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 689/1404] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:52.987792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291e37-858d-4bfc-ae24-82b82c031246 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:52.988258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291e37-858d-4bfc-ae24-82b82c031246 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:52.989399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291e37-858d-4bfc-ae24-82b82c031246 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:52.990205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 716/1405] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:52.997506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef7727-7870-4629-a96a-9311fc77d8d5 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:52.998459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef7727-7870-4629-a96a-9311fc77d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:52.998570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef7727-7870-4629-a96a-9311fc77d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:53.016376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3fef7727-7870-4629-a96a-9311fc77d8d5 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:53.021738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3fef7727-7870-4629-a96a-9311fc77d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:53.025457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 690/1406] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:53.063264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b291e37-858d-4bfc-ae24-82b82c031246 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:53.073686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b291e37-858d-4bfc-ae24-82b82c031246 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:53.077796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759a57-614c-4adb-be55-0441019d5a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:53.078431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759a57-614c-4adb-be55-0441019d5a46 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:53.078714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759a57-614c-4adb-be55-0441019d5a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:53.078985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759a57-614c-4adb-be55-0441019d5a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:53.087454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c759a57-614c-4adb-be55-0441019d5a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:53.090651 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c759a57-614c-4adb-be55-0441019d5a46 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:53.097843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 717/1407] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:19:55.243980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44815010-4577-4a41-b595-4dbd7049067a None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:55.244401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44815010-4577-4a41-b595-4dbd7049067a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:55.244621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44815010-4577-4a41-b595-4dbd7049067a None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:55.246328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 691/1408] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:55.253687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c369089-7eb3-4e67-8872-db5849c06ce0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:55.254154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c369089-7eb3-4e67-8872-db5849c06ce0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:55.254253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c369089-7eb3-4e67-8872-db5849c06ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:55.271729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8c369089-7eb3-4e67-8872-db5849c06ce0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:55.272962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8c369089-7eb3-4e67-8872-db5849c06ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:55.281408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 718/1409] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:19:55.318526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44815010-4577-4a41-b595-4dbd7049067a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:55.328722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44815010-4577-4a41-b595-4dbd7049067a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:55.332138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c875b0-3106-4b5b-a5bb-31c778f2db9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:55.332800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c875b0-3106-4b5b-a5bb-31c778f2db9e service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:55.333082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c875b0-3106-4b5b-a5bb-31c778f2db9e service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:55.333356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c875b0-3106-4b5b-a5bb-31c778f2db9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:55.342535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c875b0-3106-4b5b-a5bb-31c778f2db9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:55.343943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c875b0-3106-4b5b-a5bb-31c778f2db9e service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:55.352903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 692/1410] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:19:57.501059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b53770-e1f8-4886-b1a0-57ae84221b2d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:57.501584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b53770-e1f8-4886-b1a0-57ae84221b2d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:57.501584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b53770-e1f8-4886-b1a0-57ae84221b2d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:57.503294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 719/1411] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:19:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:19:57.510274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634707-9b11-4257-ad89-3752b593f8df None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:57.510726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634707-9b11-4257-ad89-3752b593f8df None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:57.510825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634707-9b11-4257-ad89-3752b593f8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:57.527988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-11634707-9b11-4257-ad89-3752b593f8df None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:19:57.529683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-11634707-9b11-4257-ad89-3752b593f8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:19:57.537210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 693/1412] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:19:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:19:57.576027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b53770-e1f8-4886-b1a0-57ae84221b2d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:19:57.586411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b53770-e1f8-4886-b1a0-57ae84221b2d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:19:57.589925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1b98a-3538-4d5b-bd90-c09b7356e47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:19:57.590569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b98a-3538-4d5b-bd90-c09b7356e47a service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:19:57.590859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b98a-3538-4d5b-bd90-c09b7356e47a service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:19:57.591137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1b98a-3538-4d5b-bd90-c09b7356e47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:19:57.600219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1b98a-3538-4d5b-bd90-c09b7356e47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:19:57.601744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1b98a-3538-4d5b-bd90-c09b7356e47a service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:19:57.611790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 720/1413] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:19:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:20:14.466339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22237d5f-82d5-4c80-977d-5d8b15b665be None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:14.466903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22237d5f-82d5-4c80-977d-5d8b15b665be None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:14.466903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22237d5f-82d5-4c80-977d-5d8b15b665be None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:14.468689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 694/1414] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:14.474575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae384-4734-4844-8b54-ffc6c047b4d1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:14.474984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae384-4734-4844-8b54-ffc6c047b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:14.475140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae384-4734-4844-8b54-ffc6c047b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:14.493526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-917ae384-4734-4844-8b54-ffc6c047b4d1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:14.494631 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-917ae384-4734-4844-8b54-ffc6c047b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:14.503256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 721/1415] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:20:14.551049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289d9bc-5d04-48e4-a07a-0ef5252d13de None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:14.551338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289d9bc-5d04-48e4-a07a-0ef5252d13de None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:14.551616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289d9bc-5d04-48e4-a07a-0ef5252d13de None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:14.553391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 695/1416] 10.222.0.20 () {54 vars in 966 bytes} [Tue Sep 14 22:20:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:14.558367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e67769-8c47-4b15-bcbb-4c1d9e058bb1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:14.558664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e67769-8c47-4b15-bcbb-4c1d9e058bb1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:14.558947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e67769-8c47-4b15-bcbb-4c1d9e058bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:14.577019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-03e67769-8c47-4b15-bcbb-4c1d9e058bb1 None None] MFA Rules not processed for user `a78f380f9648428989c8f0bbf87921b1`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:14.578237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-03e67769-8c47-4b15-bcbb-4c1d9e058bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:14.584508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 722/1417] 10.222.0.20 () {58 vars in 1064 bytes} [Tue Sep 14 22:20:14 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:14.592258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289d9bc-5d04-48e4-a07a-0ef5252d13de None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:14.602476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289d9bc-5d04-48e4-a07a-0ef5252d13de None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:14.605992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b389b-bd99-41a6-8780-37defef05c93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:14.607397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b389b-bd99-41a6-8780-37defef05c93 service glance] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:14.607672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b389b-bd99-41a6-8780-37defef05c93 service glance] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:14.607939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b389b-bd99-41a6-8780-37defef05c93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:14.616698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b389b-bd99-41a6-8780-37defef05c93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:14.618097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b389b-bd99-41a6-8780-37defef05c93 service glance] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:14.627079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 696/1418] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:20:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:20:16.851586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf4f80-d9c3-4048-a370-0d9c4ddba70a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:16.852196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf4f80-d9c3-4048-a370-0d9c4ddba70a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:16.852196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf4f80-d9c3-4048-a370-0d9c4ddba70a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:16.853943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 723/1419] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:16.861807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115728-e843-4ba6-a39f-807606949b05 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:16.862229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115728-e843-4ba6-a39f-807606949b05 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:16.862362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115728-e843-4ba6-a39f-807606949b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:16.879890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-48115728-e843-4ba6-a39f-807606949b05 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:16.881092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-48115728-e843-4ba6-a39f-807606949b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:16.888875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 697/1420] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:16.913488 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf4f80-d9c3-4048-a370-0d9c4ddba70a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:16.926059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf4f80-d9c3-4048-a370-0d9c4ddba70a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:16.930486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86ede-cf7d-4185-9a6c-29f118f3b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:16.931125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86ede-cf7d-4185-9a6c-29f118f3b961 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:16.931414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86ede-cf7d-4185-9a6c-29f118f3b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:16.931694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86ede-cf7d-4185-9a6c-29f118f3b961 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:16.932448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86ede-cf7d-4185-9a6c-29f118f3b961 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:16.934302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86ede-cf7d-4185-9a6c-29f118f3b961 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:16.952465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 724/1421] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 14 22:20:16 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:20:19.126181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04683715-a544-472d-8d64-1ffda61b27c5 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:19.126748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04683715-a544-472d-8d64-1ffda61b27c5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:19.126748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04683715-a544-472d-8d64-1ffda61b27c5 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:19.128542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 698/1422] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:19.135654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3916-7d07-4b99-b392-620365ffbfb9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:19.136059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3916-7d07-4b99-b392-620365ffbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:19.136225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3916-7d07-4b99-b392-620365ffbfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:19.154297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-968a3916-7d07-4b99-b392-620365ffbfb9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:19.155501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-968a3916-7d07-4b99-b392-620365ffbfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:19.163292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 725/1423] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:19.206775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04683715-a544-472d-8d64-1ffda61b27c5 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:19.221267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04683715-a544-472d-8d64-1ffda61b27c5 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:19.226592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54c00d-b2c4-4855-aa19-36b68c25ed51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:19.227221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54c00d-b2c4-4855-aa19-36b68c25ed51 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:19.227505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54c00d-b2c4-4855-aa19-36b68c25ed51 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:19.227781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54c00d-b2c4-4855-aa19-36b68c25ed51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:19.236712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54c00d-b2c4-4855-aa19-36b68c25ed51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:19.238236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54c00d-b2c4-4855-aa19-36b68c25ed51 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:19.247739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 699/1424] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:20:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:20:21.594752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9efa-009c-4209-99f7-33d6aafa1943 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:21.595315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9efa-009c-4209-99f7-33d6aafa1943 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:21.595315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9efa-009c-4209-99f7-33d6aafa1943 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:21.597100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 726/1425] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:21.604177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ea8a-e52e-4017-8443-8d98e33597a2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:21.604651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ea8a-e52e-4017-8443-8d98e33597a2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:21.604770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ea8a-e52e-4017-8443-8d98e33597a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:21.622798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e168ea8a-e52e-4017-8443-8d98e33597a2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:21.623983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e168ea8a-e52e-4017-8443-8d98e33597a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:21.631609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 700/1426] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:21.669188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b9efa-009c-4209-99f7-33d6aafa1943 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:21.680484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b9efa-009c-4209-99f7-33d6aafa1943 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:21.683494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae166ef4-47cb-4e91-9481-6afc9305a6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:21.684669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166ef4-47cb-4e91-9481-6afc9305a6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:21.684964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166ef4-47cb-4e91-9481-6afc9305a6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:21.685244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166ef4-47cb-4e91-9481-6afc9305a6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:21.694014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae166ef4-47cb-4e91-9481-6afc9305a6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:21.695428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae166ef4-47cb-4e91-9481-6afc9305a6b8 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:21.706030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 727/1427] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:20:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:20:23.906580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397530e9-8966-457a-95d2-f0e19a7b127f None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:23.907162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397530e9-8966-457a-95d2-f0e19a7b127f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:23.907162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397530e9-8966-457a-95d2-f0e19a7b127f None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:23.908956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 701/1428] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:23.915881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d177a01-534e-4888-a8c7-8a7021c27510 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:23.916329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d177a01-534e-4888-a8c7-8a7021c27510 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:23.916507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d177a01-534e-4888-a8c7-8a7021c27510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:23.934337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0d177a01-534e-4888-a8c7-8a7021c27510 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:23.935524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0d177a01-534e-4888-a8c7-8a7021c27510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:23.943440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 728/1429] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:23.983082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397530e9-8966-457a-95d2-f0e19a7b127f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:23.993590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397530e9-8966-457a-95d2-f0e19a7b127f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:23.997713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c31b5-b4d5-4d8a-8122-727ec127dcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:23.998343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c31b5-b4d5-4d8a-8122-727ec127dcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:23.998626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c31b5-b4d5-4d8a-8122-727ec127dcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:23.998955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c31b5-b4d5-4d8a-8122-727ec127dcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:24.007653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c31b5-b4d5-4d8a-8122-727ec127dcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:24.009110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c31b5-b4d5-4d8a-8122-727ec127dcf0 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:24.018263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 702/1430] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:20:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:20:26.318657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc642-1a75-40d3-9716-039cac0f8d58 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:26.319212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc642-1a75-40d3-9716-039cac0f8d58 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:26.319212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc642-1a75-40d3-9716-039cac0f8d58 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:26.321044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 729/1431] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:26.328314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022a4c-6ee8-4a02-ac2c-1cd11014996f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:26.328778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022a4c-6ee8-4a02-ac2c-1cd11014996f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:26.328916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022a4c-6ee8-4a02-ac2c-1cd11014996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:26.346271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b5022a4c-6ee8-4a02-ac2c-1cd11014996f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:26.347467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b5022a4c-6ee8-4a02-ac2c-1cd11014996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:26.355150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 703/1432] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:26.398284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc642-1a75-40d3-9716-039cac0f8d58 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:26.408671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc642-1a75-40d3-9716-039cac0f8d58 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:26.412089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342df802-2c44-48ba-a737-f9f6b24c584b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:26.412757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342df802-2c44-48ba-a737-f9f6b24c584b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:26.413039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342df802-2c44-48ba-a737-f9f6b24c584b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:26.413311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342df802-2c44-48ba-a737-f9f6b24c584b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:26.422258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342df802-2c44-48ba-a737-f9f6b24c584b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:26.423666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342df802-2c44-48ba-a737-f9f6b24c584b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:26.432516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 730/1433] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:20:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:20:28.993551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f115ced-3432-43e9-888b-d8a826fc9ca0 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:28.993969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f115ced-3432-43e9-888b-d8a826fc9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:28.994110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f115ced-3432-43e9-888b-d8a826fc9ca0 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:28.995891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 704/1434] 10.222.0.20 () {54 vars in 926 bytes} [Tue Sep 14 22:20:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:20:29.003682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fb945-d550-4e2f-ba73-f738cd4857f7 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:29.004124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fb945-d550-4e2f-ba73-f738cd4857f7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:29.004250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fb945-d550-4e2f-ba73-f738cd4857f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:29.022226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e84fb945-d550-4e2f-ba73-f738cd4857f7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:20:29.023423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e84fb945-d550-4e2f-ba73-f738cd4857f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:20:29.031777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 731/1435] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 14 22:20:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:20:29.071266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f115ced-3432-43e9-888b-d8a826fc9ca0 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:20:29.081928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f115ced-3432-43e9-888b-d8a826fc9ca0 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:20:29.085416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18114c3c-d6e3-4dc1-a220-b6803fc3e883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:20:29.086075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114c3c-d6e3-4dc1-a220-b6803fc3e883 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:20:29.086358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114c3c-d6e3-4dc1-a220-b6803fc3e883 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:20:29.086634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114c3c-d6e3-4dc1-a220-b6803fc3e883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:20:29.095908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114c3c-d6e3-4dc1-a220-b6803fc3e883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:20:29.097364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114c3c-d6e3-4dc1-a220-b6803fc3e883 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:20:29.107802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 705/1436] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:20:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:21:45.704749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:45.705414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:45.705414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:45.723826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:21:45.731057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:21:45.733597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 732/1437] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:21:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:21:45.741626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:45.742126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:45.742233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:45.760210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:21:45.761423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:21:45.770647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 706/1438] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:21:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:21:45.775446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:45.784956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f8039-4b5b-4746-9686-044c6665caa2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:45.789574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:45.790230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:45.790515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:45.791287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:45.792033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:21:45.792342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:45.793955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:45.804973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 733/1439] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:21:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:21:45.813214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:45.821957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b83f33-4588-4a6a-b6f3-5dd22e158c27 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:45.826431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:45.827070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:45.827352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:45.827626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:45.828314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:45.830204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.005099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 707/1440] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:21:45 2021] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:21:46.005338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:46.016613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c70cb-a1b1-4bca-aed7-f20d7ac2ca94 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:46.070786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:46.071455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.072363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.072363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.072709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:46.074588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.152678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 734/1441] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:21:46 2021] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:21:46.156918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:46.167424 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92db3-d398-426f-9308-419988e3242b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:46.171822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:46.172533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.172957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.173236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.173955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:46.175521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.188411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 708/1442] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:21:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:21:46.192517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:46.202294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bd750-6f51-4c06-9989-802d7abf7d82 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:46.206795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b024e14-f71c-44d8-bf15-d858d06453f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:46.207450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024e14-f71c-44d8-bf15-d858d06453f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.207765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024e14-f71c-44d8-bf15-d858d06453f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.208047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024e14-f71c-44d8-bf15-d858d06453f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.208800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b024e14-f71c-44d8-bf15-d858d06453f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:46.210369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b024e14-f71c-44d8-bf15-d858d06453f6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.224175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 735/1443] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:21:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:21:46.228967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:46.242088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b34d-45a1-4bf8-bbc6-e87465d3559f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:46.246730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:46.247614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.247899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.248180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] PATH_INFO: `/v3/projects/b959d8c29d37410fa9b5e5b9c62898e4/users/d1a9f1a6791543d4aedbc5701bb56c92/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.262154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b959d8c29d37410fa9b5e5b9c62898e4, user_id=d1a9f1a6791543d4aedbc5701bb56c92, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:46.264766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.311932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 709/1444] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:21:46 2021] PUT /identity/v3/projects/b959d8c29d37410fa9b5e5b9c62898e4/users/d1a9f1a6791543d4aedbc5701bb56c92/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:21:46.324074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f27d-adc5-4d57-9f75-702cf8f95bf8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.324370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f27d-adc5-4d57-9f75-702cf8f95bf8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.324685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f27d-adc5-4d57-9f75-702cf8f95bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.350173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-9782f27d-adc5-4d57-9f75-702cf8f95bf8 None None] MFA Rules not processed for user `d1a9f1a6791543d4aedbc5701bb56c92`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:21:46.351403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9782f27d-adc5-4d57-9f75-702cf8f95bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:21:46.411434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 736/1445] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:21:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:21:46.423274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:46.489496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d7eb8-0667-4c08-a728-63a52e7634ca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:46.494902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:46.495536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.495819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.496096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.503602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:46.505211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.514503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 710/1446] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:21:46 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:21:46.580774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde4aa-3521-49d5-a1e1-777888cf6e4a None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.581074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde4aa-3521-49d5-a1e1-777888cf6e4a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.581362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde4aa-3521-49d5-a1e1-777888cf6e4a None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.583057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 737/1447] 10.222.0.20 () {52 vars in 829 bytes} [Tue Sep 14 22:21:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:21:46.586593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:46.645032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910d10-45c9-4e09-8aab-10bb35e6fab6 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:46.649522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:46.650967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.651251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.651528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] PATH_INFO: `/v3/users/d1a9f1a6791543d4aedbc5701bb56c92` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.652723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a9f1a6791543d4aedbc5701bb56c92)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:46.653733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:21:46.653733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:21:46.653733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:21:46.654932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:46.850887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a9f1a6791543d4aedbc5701bb56c92'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:46.851515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a9f1a6791543d4aedbc5701bb56c92'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:46.852231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a9f1a6791543d4aedbc5701bb56c92'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:46.929532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a9f1a6791543d4aedbc5701bb56c92'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:46.949304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a9f1a6791543d4aedbc5701bb56c92'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:46.966812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 711/1448] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:21:46 2021] DELETE /identity/v3/users/d1a9f1a6791543d4aedbc5701bb56c92 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:21:46.971189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:46.971691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:46.971805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:46.989214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:21:46.990379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:21:47.045622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 738/1449] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:21:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:21:47.056045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:47.057574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:21:47.115422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6075-3b00-4bd3-a333-4cc9ac281660 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:47.118980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1f743-adec-411a-8c03-c9be2340397b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:47.119615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1f743-adec-411a-8c03-c9be2340397b service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:47.119897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1f743-adec-411a-8c03-c9be2340397b service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:47.120170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1f743-adec-411a-8c03-c9be2340397b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:47.128704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1f743-adec-411a-8c03-c9be2340397b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:47.130120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1f743-adec-411a-8c03-c9be2340397b service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:47.139239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 712/1450] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:21:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:21:47.594589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:21:47.595999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:21:47.608038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a030-ecc3-42f6-ab90-7cc6d2094db5 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:21:47.612582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:21:47.613442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:21:47.613727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:21:47.614000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] PATH_INFO: `/v3/projects/b959d8c29d37410fa9b5e5b9c62898e4` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:21:47.615171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b959d8c29d37410fa9b5e5b9c62898e4)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:21:47.616168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:21:47.616168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:21:47.616168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:21:47.617416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:21:47.740154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b959d8c29d37410fa9b5e5b9c62898e4', 'request_id': 'req-54bacd4d-5e82-41a4-8561-de927b7b68a8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:47.745914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b959d8c29d37410fa9b5e5b9c62898e4', 'request_id': 'req-54bacd4d-5e82-41a4-8561-de927b7b68a8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:47.758714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b959d8c29d37410fa9b5e5b9c62898e4', 'request_id': 'req-54bacd4d-5e82-41a4-8561-de927b7b68a8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:47.958362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] The token cache is being invalidate because project b959d8c29d37410fa9b5e5b9c62898e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:21:47.958656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:47.959281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-54bacd4d-5e82-41a4-8561-de927b7b68a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:21:47.960844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 739/1451] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:21:47 2021] DELETE /identity/v3/projects/b959d8c29d37410fa9b5e5b9c62898e4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:23:17.439511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7e20-65b3-4508-803d-92c0d6e8e13a None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:17.440051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7e20-65b3-4508-803d-92c0d6e8e13a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:17.440051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7e20-65b3-4508-803d-92c0d6e8e13a None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:17.441810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 713/1452] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 14 22:23:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:23:17.447214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7b5c-d569-4d37-be43-320823fb1767 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:17.447661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7b5c-d569-4d37-be43-320823fb1767 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:17.447769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7b5c-d569-4d37-be43-320823fb1767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:17.465749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-efdb7b5c-d569-4d37-be43-320823fb1767 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:17.466943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-efdb7b5c-d569-4d37-be43-320823fb1767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:17.525380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 740/1453] 127.0.0.1 () {58 vars in 999 bytes} [Tue Sep 14 22:23:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:17.608310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d071-d4ee-462b-bd7c-f529934c50d1 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:17.608627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d071-d4ee-462b-bd7c-f529934c50d1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:17.608912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d071-d4ee-462b-bd7c-f529934c50d1 None None] PATH_INFO: `/v3` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:17.610228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 714/1454] 10.222.0.43 () {54 vars in 926 bytes} [Tue Sep 14 22:23:17 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:23:17.617431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d935f7-a4ed-47c1-805f-bad14bdcb48f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:17.617721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d935f7-a4ed-47c1-805f-bad14bdcb48f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:17.618001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d935f7-a4ed-47c1-805f-bad14bdcb48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:17.635742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-45d935f7-a4ed-47c1-805f-bad14bdcb48f None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:17.636970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-45d935f7-a4ed-47c1-805f-bad14bdcb48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:17.679382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d071-d4ee-462b-bd7c-f529934c50d1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:17.681154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d6a1d071-d4ee-462b-bd7c-f529934c50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:17.697450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 741/1455] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 14 22:23:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:23:17.760492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d071-d4ee-462b-bd7c-f529934c50d1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:17.765892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ad42a-b882-4eeb-9a02-c5c5394e25ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:17.766534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad42a-b882-4eeb-9a02-c5c5394e25ac service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:17.766819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad42a-b882-4eeb-9a02-c5c5394e25ac service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:17.767099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad42a-b882-4eeb-9a02-c5c5394e25ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:17.774894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ad42a-b882-4eeb-9a02-c5c5394e25ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:17.776505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ad42a-b882-4eeb-9a02-c5c5394e25ac service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:17.785503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 715/1456] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:23:19.148726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1a40-0791-40a0-b9ce-5115aed12086 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:19.149230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1a40-0791-40a0-b9ce-5115aed12086 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:19.149342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1a40-0791-40a0-b9ce-5115aed12086 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:19.151050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 742/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 14 22:23:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:19.156308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5901-16db-4b07-949a-52f3d48629a1 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:19.156752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5901-16db-4b07-949a-52f3d48629a1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:19.156906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5901-16db-4b07-949a-52f3d48629a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:19.174332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7c4a5901-16db-4b07-949a-52f3d48629a1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:19.175517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7c4a5901-16db-4b07-949a-52f3d48629a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:19.183928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 716/1458] 127.0.0.1 () {58 vars in 999 bytes} [Tue Sep 14 22:23:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:19.338030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1a40-0791-40a0-b9ce-5115aed12086 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:19.351813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1a40-0791-40a0-b9ce-5115aed12086 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:19.357890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc549db-7cba-47ab-96b9-aecf126f95f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:19.358520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc549db-7cba-47ab-96b9-aecf126f95f9 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:19.358805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc549db-7cba-47ab-96b9-aecf126f95f9 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:19.359082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc549db-7cba-47ab-96b9-aecf126f95f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:19.366812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc549db-7cba-47ab-96b9-aecf126f95f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:19.368386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc549db-7cba-47ab-96b9-aecf126f95f9 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:19.377933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 743/1459] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:26.378242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453a6c-2c82-4604-8aca-db3efa5b5350 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:26.378674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453a6c-2c82-4604-8aca-db3efa5b5350 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:26.378784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453a6c-2c82-4604-8aca-db3efa5b5350 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:26.380580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 717/1460] 10.222.0.20 () {54 vars in 960 bytes} [Tue Sep 14 22:23:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:26.386274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d9c4-adce-48e9-8efd-e0ccab8a3f4e None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:26.386675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d9c4-adce-48e9-8efd-e0ccab8a3f4e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:26.386832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d9c4-adce-48e9-8efd-e0ccab8a3f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:26.404981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-9656d9c4-adce-48e9-8efd-e0ccab8a3f4e None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:26.406155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9656d9c4-adce-48e9-8efd-e0ccab8a3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:26.414538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 744/1461] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 14 22:23:26 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:26.422081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c453a6c-2c82-4604-8aca-db3efa5b5350 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:26.435511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c453a6c-2c82-4604-8aca-db3efa5b5350 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:26.440353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a58bd7-b564-4556-a094-f04ba619ea2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:26.441016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58bd7-b564-4556-a094-f04ba619ea2d service placement] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:26.441303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58bd7-b564-4556-a094-f04ba619ea2d service placement] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:26.441580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58bd7-b564-4556-a094-f04ba619ea2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:26.450162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a58bd7-b564-4556-a094-f04ba619ea2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:26.451733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a58bd7-b564-4556-a094-f04ba619ea2d service placement] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:26.461098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 718/1462] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:31.141877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f312-1151-4184-9b77-dece56094659 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:31.142387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f312-1151-4184-9b77-dece56094659 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:31.142499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f312-1151-4184-9b77-dece56094659 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:31.144326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 745/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 14 22:23:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:31.149816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a243e-709b-4686-ba98-cd318c50138b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:31.150254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a243e-709b-4686-ba98-cd318c50138b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:31.150382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a243e-709b-4686-ba98-cd318c50138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:31.168011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-268a243e-709b-4686-ba98-cd318c50138b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:31.169212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-268a243e-709b-4686-ba98-cd318c50138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:31.176839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 719/1464] 127.0.0.1 () {58 vars in 999 bytes} [Tue Sep 14 22:23:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:31.330780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f312-1151-4184-9b77-dece56094659 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:31.344820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f312-1151-4184-9b77-dece56094659 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:31.350132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3266a1-577d-4cbb-867f-ac752eaddc2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:31.350771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3266a1-577d-4cbb-867f-ac752eaddc2f service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:31.351059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3266a1-577d-4cbb-867f-ac752eaddc2f service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:31.351339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3266a1-577d-4cbb-867f-ac752eaddc2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:31.359904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3266a1-577d-4cbb-867f-ac752eaddc2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:31.361498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3266a1-577d-4cbb-867f-ac752eaddc2f service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:31.371062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 746/1465] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:32.739196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655012-00eb-468c-a362-825b37abc76f None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:32.739776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655012-00eb-468c-a362-825b37abc76f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:32.739776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655012-00eb-468c-a362-825b37abc76f None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:32.741564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 720/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 14 22:23:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:32.746943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c4b21-7f8c-44c7-8f1a-30fbb08d9d52 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:32.747344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c4b21-7f8c-44c7-8f1a-30fbb08d9d52 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:32.747514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c4b21-7f8c-44c7-8f1a-30fbb08d9d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:32.765637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a17c4b21-7f8c-44c7-8f1a-30fbb08d9d52 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:32.766834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a17c4b21-7f8c-44c7-8f1a-30fbb08d9d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:32.774655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 747/1467] 127.0.0.1 () {58 vars in 999 bytes} [Tue Sep 14 22:23:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:32.929636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655012-00eb-468c-a362-825b37abc76f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:32.943624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655012-00eb-468c-a362-825b37abc76f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:32.949525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7ad2d-56d1-4ea6-a634-1aef35eb3b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:32.950159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ad2d-56d1-4ea6-a634-1aef35eb3b39 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:32.950446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ad2d-56d1-4ea6-a634-1aef35eb3b39 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:32.950723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ad2d-56d1-4ea6-a634-1aef35eb3b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:32.958560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7ad2d-56d1-4ea6-a634-1aef35eb3b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:32.960140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7ad2d-56d1-4ea6-a634-1aef35eb3b39 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:32.970001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 721/1468] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:37.306632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608586-218a-47e3-a061-585694b9dab3 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:37.307147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608586-218a-47e3-a061-585694b9dab3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:37.307245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608586-218a-47e3-a061-585694b9dab3 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:37.309686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 748/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 14 22:23:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:23:37.315363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74593-b53c-490d-aeb6-ed9f8d17c493 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:37.315766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74593-b53c-490d-aeb6-ed9f8d17c493 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:37.315931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74593-b53c-490d-aeb6-ed9f8d17c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:37.333481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1de74593-b53c-490d-aeb6-ed9f8d17c493 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:37.334666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1de74593-b53c-490d-aeb6-ed9f8d17c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:37.342325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 722/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 14 22:23:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:37.379882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608586-218a-47e3-a061-585694b9dab3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:37.381576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-10608586-218a-47e3-a061-585694b9dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:37.436223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608586-218a-47e3-a061-585694b9dab3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:37.439811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29ac57-279a-4898-8984-1f36664fb00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:37.440474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ac57-279a-4898-8984-1f36664fb00b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:37.440763 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ac57-279a-4898-8984-1f36664fb00b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:37.441042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ac57-279a-4898-8984-1f36664fb00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:37.449986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29ac57-279a-4898-8984-1f36664fb00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:37.451437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29ac57-279a-4898-8984-1f36664fb00b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:37.460494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 749/1471] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:39.607810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300235-8a92-490c-885e-5b5cc658c3a2 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:39.608374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300235-8a92-490c-885e-5b5cc658c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:39.608374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300235-8a92-490c-885e-5b5cc658c3a2 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:39.610206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 723/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 14 22:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:39.617329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7efa53-a049-4651-b0dd-42e90442057b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:39.617753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7efa53-a049-4651-b0dd-42e90442057b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:39.617903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7efa53-a049-4651-b0dd-42e90442057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:39.635146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ff7efa53-a049-4651-b0dd-42e90442057b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:39.636886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ff7efa53-a049-4651-b0dd-42e90442057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:39.644490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 750/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 14 22:23:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:39.681211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300235-8a92-490c-885e-5b5cc658c3a2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:39.691566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300235-8a92-490c-885e-5b5cc658c3a2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:39.694969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d63e-f811-49d6-8f94-9ed2b47a89f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:39.695596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d63e-f811-49d6-8f94-9ed2b47a89f0 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:39.695878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d63e-f811-49d6-8f94-9ed2b47a89f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:39.696149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d63e-f811-49d6-8f94-9ed2b47a89f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:39.705172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d63e-f811-49d6-8f94-9ed2b47a89f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:39.706584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d63e-f811-49d6-8f94-9ed2b47a89f0 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:39.716230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 724/1474] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:43.543876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a73a6-9fad-43f8-bfb3-bdaaa4bc338d None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:43.544447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a73a6-9fad-43f8-bfb3-bdaaa4bc338d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:43.544447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a73a6-9fad-43f8-bfb3-bdaaa4bc338d None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:43.546362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 751/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 14 22:23:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:43.553317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e474ff-87b7-458e-8d78-52a93899796b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:43.553808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e474ff-87b7-458e-8d78-52a93899796b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:43.553924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e474ff-87b7-458e-8d78-52a93899796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:43.571648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d0e474ff-87b7-458e-8d78-52a93899796b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:43.572901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d0e474ff-87b7-458e-8d78-52a93899796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:43.581218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 725/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 14 22:23:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:43.632829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a73a6-9fad-43f8-bfb3-bdaaa4bc338d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:43.634591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c80a73a6-9fad-43f8-bfb3-bdaaa4bc338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:43.689981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a73a6-9fad-43f8-bfb3-bdaaa4bc338d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:43.693618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdc1e0-d891-4fe5-aad3-a28c2b8c5380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:43.694258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc1e0-d891-4fe5-aad3-a28c2b8c5380 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:43.694549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc1e0-d891-4fe5-aad3-a28c2b8c5380 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:43.694835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc1e0-d891-4fe5-aad3-a28c2b8c5380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:43.704255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdc1e0-d891-4fe5-aad3-a28c2b8c5380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:43.705771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdc1e0-d891-4fe5-aad3-a28c2b8c5380 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:43.715055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 752/1477] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:23:45.882720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101296d-ad62-4bd3-9888-c023b517304b None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:45.883302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101296d-ad62-4bd3-9888-c023b517304b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:45.883302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101296d-ad62-4bd3-9888-c023b517304b None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:45.885097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 726/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 14 22:23:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:45.892541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311db02-94c6-478a-ae62-3b2ae21d8df8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:45.892987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311db02-94c6-478a-ae62-3b2ae21d8df8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:45.893173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311db02-94c6-478a-ae62-3b2ae21d8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:45.910177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a311db02-94c6-478a-ae62-3b2ae21d8df8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:45.911361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a311db02-94c6-478a-ae62-3b2ae21d8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:45.918996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 753/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 14 22:23:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:45.969280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73156f8-3e23-4b94-a6a0-df35f06f382c None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:45.969580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73156f8-3e23-4b94-a6a0-df35f06f382c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:45.969852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73156f8-3e23-4b94-a6a0-df35f06f382c None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:45.971677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 727/1480] 10.222.0.20 () {54 vars in 967 bytes} [Tue Sep 14 22:23:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:23:45.977335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3f528-a4ee-44a5-a605-26daa6ecf943 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:45.977633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3f528-a4ee-44a5-a605-26daa6ecf943 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:45.977918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3f528-a4ee-44a5-a605-26daa6ecf943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:45.996403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-31c3f528-a4ee-44a5-a605-26daa6ecf943 None None] MFA Rules not processed for user `bc75144a14f943a7adcb56dfdb808ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:23:45.997611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-31c3f528-a4ee-44a5-a605-26daa6ecf943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:23:46.003930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 754/1481] 10.222.0.20 () {58 vars in 1065 bytes} [Tue Sep 14 22:23:45 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:23:46.012576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73156f8-3e23-4b94-a6a0-df35f06f382c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:23:46.022905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73156f8-3e23-4b94-a6a0-df35f06f382c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:23:46.026621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15b80-706e-4922-812d-5dba70fe3030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:23:46.027676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15b80-706e-4922-812d-5dba70fe3030 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:23:46.028140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15b80-706e-4922-812d-5dba70fe3030 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:23:46.028710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15b80-706e-4922-812d-5dba70fe3030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:23:46.037985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15b80-706e-4922-812d-5dba70fe3030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:23:46.039403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15b80-706e-4922-812d-5dba70fe3030 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:23:46.048640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 728/1482] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:23:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:06.735675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:06.736268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:06.736268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:06.762696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:06.764074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:06.776783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 755/1483] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:06.785088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:06.786028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:06.786523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:06.813219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:06.814966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:06.834145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 729/1484] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:06.839322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:06.853747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab1c4-b438-4e64-935e-8117db0d78cb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:06.863207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:06.863885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:06.864175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:06.864477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:06.865218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:06.865535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:06.867144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615dc16-3b71-4966-985f-11d787b2222f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:06.885776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 756/1485] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:06.894725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:06.908857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541fea4-6734-4b46-89e2-5a2b94fe7458 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:06.913981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:06.914905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:06.915602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:06.916101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:06.917045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:06.919651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:06.934898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ed219-b680-4f44-b726-f3c0702b090d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:06.935223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ed219-b680-4f44-b726-f3c0702b090d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:06.935465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ed219-b680-4f44-b726-f3c0702b090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:06.969486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d32ed219-b680-4f44-b726-f3c0702b090d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:06.970701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d32ed219-b680-4f44-b726-f3c0702b090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:06.983853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 757/1486] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:06.991531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:06.991759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:06.992042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.018460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.019653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.030019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 758/1487] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:07.041975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.054095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e080f-c567-444d-b290-c17673a1aa87 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.062622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.064884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.064884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.064884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.065169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.065443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.066896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49676bf-7deb-42c9-b61e-5fe50fcb9147 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.069277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 730/1488] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:06 2021] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:07.080826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.087483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 759/1489] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:25:07.090521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.090521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.090521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.128478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.128478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.182288 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97bc43-331d-4cf2-917f-474bc31b8fec admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.188363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eeb71-2485-45de-83d6-41151ea70287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.189367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eeb71-2485-45de-83d6-41151ea70287 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.189876 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eeb71-2485-45de-83d6-41151ea70287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.190401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eeb71-2485-45de-83d6-41151ea70287 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.191314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eeb71-2485-45de-83d6-41151ea70287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.193484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eeb71-2485-45de-83d6-41151ea70287 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.197525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 760/1490] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.198323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.208444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3943555-f340-4445-957f-c6dcb5273d1b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.213188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b909dd9-c7d4-4234-bffc-a317f9effbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.213860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b909dd9-c7d4-4234-bffc-a317f9effbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.214143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b909dd9-c7d4-4234-bffc-a317f9effbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.214421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b909dd9-c7d4-4234-bffc-a317f9effbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.215674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b909dd9-c7d4-4234-bffc-a317f9effbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.217680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b909dd9-c7d4-4234-bffc-a317f9effbb2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.273462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 731/1491] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:07.274713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb7a0-95c9-45b5-9319-239b999e19d0 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.275003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb7a0-95c9-45b5-9319-239b999e19d0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.275282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb7a0-95c9-45b5-9319-239b999e19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.294160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-fd8fb7a0-95c9-45b5-9319-239b999e19d0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.295345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-fd8fb7a0-95c9-45b5-9319-239b999e19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.303018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 732/1492] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.304186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba400e-f429-4edf-924c-86b7e956805a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.304496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba400e-f429-4edf-924c-86b7e956805a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.304780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba400e-f429-4edf-924c-86b7e956805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.320323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 761/1493] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:07.321548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645459-77eb-465e-9499-363569c69f35 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.321840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645459-77eb-465e-9499-363569c69f35 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.322123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645459-77eb-465e-9499-363569c69f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.322233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-00ba400e-f429-4edf-924c-86b7e956805a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.323419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-00ba400e-f429-4edf-924c-86b7e956805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.339199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-bd645459-77eb-465e-9499-363569c69f35 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.340459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bd645459-77eb-465e-9499-363569c69f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.380195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 733/1494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.381743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83616-0773-4af9-beac-c50a07570c4c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.382037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83616-0773-4af9-beac-c50a07570c4c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.382318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83616-0773-4af9-beac-c50a07570c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.395739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 762/1495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.397063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.397358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.397637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.399392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-15c83616-0773-4af9-beac-c50a07570c4c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.400624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-15c83616-0773-4af9-beac-c50a07570c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.408493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 734/1496] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.410505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955aaa-495b-4e71-931f-8881514a4e1e None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.410959 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955aaa-495b-4e71-931f-8881514a4e1e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.411408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955aaa-495b-4e71-931f-8881514a4e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.417172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.418874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.426689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 763/1497] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.427485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.431085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7d955aaa-495b-4e71-931f-8881514a4e1e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.432252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7d955aaa-495b-4e71-931f-8881514a4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.437315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8fb96-47da-442d-952d-d2619a038bf3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.440835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 735/1498] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.441894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3274c85-0b87-4e59-82c0-2db9ee2217ce None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.442019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.442182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3274c85-0b87-4e59-82c0-2db9ee2217ce None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.442461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3274c85-0b87-4e59-82c0-2db9ee2217ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.442594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.442887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.443171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.443897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.445514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.456910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 764/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:07.457729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.463651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d3274c85-0b87-4e59-82c0-2db9ee2217ce None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.465419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d3274c85-0b87-4e59-82c0-2db9ee2217ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.467637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d5bbc-f7d1-4702-b5f2-a1ec48b0012f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.472146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.472821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.473108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.473202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 736/1500] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.474649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.474649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.474868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82acf63-8f85-417d-8523-aeebb2274854 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.474868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82acf63-8f85-417d-8523-aeebb2274854 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.475031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82acf63-8f85-417d-8523-aeebb2274854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.475946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.492260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b82acf63-8f85-417d-8523-aeebb2274854 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.493448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b82acf63-8f85-417d-8523-aeebb2274854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.501735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 737/1501] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.502919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.503208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.503488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.521260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.525284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.530070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 738/1502] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.530803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.539741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ff70c-cd05-4f68-b3e7-c86145cd2aff None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.544234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.544885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.545166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.545442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.546137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.546443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.547997 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374213c-27a2-4358-a3e6-b93e9339bddd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.559472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 739/1503] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:07.560778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c2cd-2054-4baa-b3e5-1b523b4e0863 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.561056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c2cd-2054-4baa-b3e5-1b523b4e0863 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.561331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c2cd-2054-4baa-b3e5-1b523b4e0863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.578677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-fd79c2cd-2054-4baa-b3e5-1b523b4e0863 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.579828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-fd79c2cd-2054-4baa-b3e5-1b523b4e0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.587503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 740/1504] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.588732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.589013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.589290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.606156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:07.607263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:07.614792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 741/1505] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:07.615517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.624654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1018328-e880-4a33-a911-3aa57df203fd None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.627848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 765/1506] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:07.628795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.631500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.632138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.632437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.632718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.633429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.635043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.640804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c4e8-41b1-460f-a945-df84a872656e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.648440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 742/1507] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:07.648591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.648712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.648805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.648805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.648805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.648805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.648805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.650144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.655413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545e4a-73d7-4562-98f2-2119adf1b284 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.660105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.660766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.661058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.661364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.662069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.669510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.669646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 766/1508] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:07.669646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.669827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.675622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 743/1509] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:07.676375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.685435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985713be-f99e-4484-86bf-f73f41adef1c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.685999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d79f-11fe-4af9-98d8-f99273e9ab11 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.690047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.690486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.690694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.691090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.691198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.691381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.691491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.691644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.692075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.692312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.692437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.694012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.694324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.713117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 767/1510] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:07.713117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.716007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68beafa-4cd7-4c77-b38c-1bcb65323d4b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.720493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.721112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.721395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.721670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.722410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.722717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.724257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.735983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 768/1511] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:07.736858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.745703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9c4c3-37cd-49cd-b205-127cd5aba5f3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.750759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.751359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.751647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.751920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.752634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:07.752936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.754667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.766291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 769/1512] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:07.767026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.775994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647b871-76dc-4222-adf8-7328b754e9a7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.780376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.781011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.781296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.781599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.782436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.784139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.795269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 744/1513] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:07.795269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.795836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 770/1514] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:07.795836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.805775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7bdd2-2131-4e7e-b120-aef89b3e9bc4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.856925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee96c-d0a5-4823-948a-33f45546efdd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:07.859162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.859830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.860113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.860391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.861118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.863004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.866100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:07.867017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:07.867371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:07.867680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] PATH_INFO: `/v3/projects/bdd7aa5bf21343faa752259d5016158e/users/2a2c44ef949e40029785026e27f77bb2/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:07.885483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd7aa5bf21343faa752259d5016158e, user_id=2a2c44ef949e40029785026e27f77bb2, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:07.888235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:07.959442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 771/1515] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:07.960251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:07.999111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 745/1516] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:07 2021] PUT /identity/v3/projects/bdd7aa5bf21343faa752259d5016158e/users/2a2c44ef949e40029785026e27f77bb2/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:08.009421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.021300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce67d-6e77-494d-bb83-b8b2dfc2acea admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.067802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277008-11c4-4fc3-870e-3c53c9668673 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.072651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.073337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.073627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.073907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.074622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.075202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.075871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.076158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.076465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.076587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.077157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.079047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.157192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 746/1517] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.158121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.184016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 772/1518] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:07 2021] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.188390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.218829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bf91e-3352-4024-9f35-64d70c527f34 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.256625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334d457-0ec8-4996-806d-f809d9442389 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.261599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.262939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.263225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.263503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.264190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.266128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.273513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.274182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.274470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.274753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.275434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.277390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.380508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 773/1519] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.381249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.409275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 747/1520] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/projects => generated 389 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.409972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.440883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659be15-895e-45b3-971b-a2bd41b3cc22 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.481947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6570-36ac-453b-a517-b746e3b3c8a2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.486746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.487444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.487734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.488018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.488785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.490384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.501727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 748/1521] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:08 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:08.501956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2497d-638c-4aba-9940-263ab6c703f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.502544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.502732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2497d-638c-4aba-9940-263ab6c703f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.503016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2497d-638c-4aba-9940-263ab6c703f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.503288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2497d-638c-4aba-9940-263ab6c703f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.503989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2497d-638c-4aba-9940-263ab6c703f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.505944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2497d-638c-4aba-9940-263ab6c703f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.516043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da8bd-54c8-4110-8a5f-a6f4511eb41c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.520772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.521428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.521715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.521994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.522734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.524746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.615924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 774/1522] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.617233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.617522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.617826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.642820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] MFA Rules not processed for user `2a2c44ef949e40029785026e27f77bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:08.643947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:08.650129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 749/1523] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.661542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.661542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aec8b-d358-4b0d-a27a-ff28b4a4d0f3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.665365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.666015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.666299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.666576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.667243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.669745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.705130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 775/1524] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:08.709672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.715702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce19ed-3818-4845-862e-0c62cbc89321 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.720222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.720911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.721244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.721523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.722227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.724197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.787992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 750/1525] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.788902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.798798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564d874-b154-416c-a619-33759abf47b2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.803308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.803947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.804229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.804586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.805236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.807132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.821595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 776/1526] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.822509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.832041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37d63-1006-475c-acae-45e5fc745164 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.836687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.837328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.837611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.837887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.838556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.840440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.907066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 751/1527] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.907860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.917314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533922bb-c234-4d6f-8def-01653fe37798 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.922353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.923230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.923511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.923787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] PATH_INFO: `/v3/projects/03e4651fb0b445f5bb276ac2a61a69b8/users/d8252f18c467437699c3fb15f28ff9fb/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.936226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 777/1528] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:08.939923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.940046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e4651fb0b445f5bb276ac2a61a69b8, user_id=d8252f18c467437699c3fb15f28ff9fb, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.941624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.946557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910464b-078d-47ed-82db-ad997cb0d4d0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.951200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.951851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.952134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.952409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.953153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.954704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.964625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 778/1529] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:08 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:08.967519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:08.974830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903269e-105b-43bc-9cd9-f07358adadbd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:08.979259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:08.979880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:08.980171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:08.981363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:08.982044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:08.983530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:08.992869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 779/1530] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:08 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:08.993768 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.002845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca03543-f2f6-420f-8cf8-b3308b2a8116 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.007342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.007939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.008228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.008547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.009208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.011015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.015578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 752/1531] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:08 2021] PUT /identity/v3/projects/03e4651fb0b445f5bb276ac2a61a69b8/users/d8252f18c467437699c3fb15f28ff9fb/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:09.016386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.074047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f1b5-8f5c-48e6-81ba-786421a28d62 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.078665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.079319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.079600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.079889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.080610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.082178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.094635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 780/1532] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:08 2021] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:09.094818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 753/1533] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.095425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.095555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.102180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157bc8-8f7b-452f-b6b0-ac67fb2bc251 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.155653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.156390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.156703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.156984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.157542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a79fe-4164-4a82-9874-e93f90cedbc0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.157703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.159287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.162487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.163143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.163428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.163722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.164502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.166695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.169436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 754/1534] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.170373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.179852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5606c4d-818e-447d-b599-87811569041b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.183065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 781/1535] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.183065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.185011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.185656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.185946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.186239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.187099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.188717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.190672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b83e5-f7ce-42df-a40c-dd19b91be97b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.195423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aebe77-aa35-4d79-b0a1-0f5be4093a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.196061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aebe77-aa35-4d79-b0a1-0f5be4093a39 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.196349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aebe77-aa35-4d79-b0a1-0f5be4093a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.196677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aebe77-aa35-4d79-b0a1-0f5be4093a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.197384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aebe77-aa35-4d79-b0a1-0f5be4093a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.201492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 755/1536] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.201623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aebe77-aa35-4d79-b0a1-0f5be4093a39 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.201733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.208329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8fb2c-f193-454d-8b3a-d06c154f2b33 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.209162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 782/1537] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.210289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.210576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.210861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.215594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.216230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.216539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.216814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.217510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.219062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.228837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:09.229154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 756/1538] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.229901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.230027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:09.240073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61835742-a3d0-4960-b853-dd7a8c1b1f76 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.242623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 783/1539] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:09.245711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.245829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.245829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.245829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.246135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.246855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.248677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.252822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04f603-0d70-4330-b109-c97db85ab8e0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.257664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.258329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.258611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.258886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.259608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.261223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.271139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 784/1540] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.274376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.281235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaac2b-545b-4e49-adbd-28ad129b4eea admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.285757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.286355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.286640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.286924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.287600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.289190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.298985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 785/1541] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.299718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.308442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9c83-48b7-4f8d-a3ab-0d3d3e92af03 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.313714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.314336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.314622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.314902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.315623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.317151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.327556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 786/1542] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.328304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.337105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f96e61-dc40-4adc-a5e6-c46c13efcafc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.342198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.342786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.343070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.343342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.344013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.345518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.356198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 757/1543] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:09 2021] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:09.356198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.356490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 787/1544] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.356490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.363597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3d648-3842-4d2f-bd18-65f5017a78b9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.367193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f3c99-13da-46a7-808b-ab050ecd98ab admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.368236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.369135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.369419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.369704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] PATH_INFO: `/v3/projects/794fe0b68dcf4ced9125be94786be1bd/users/19410737ca1d477b8e5258d11f2ed33e/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.372099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.373174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.373464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.373905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] PATH_INFO: `/v3/projects/64767f181b224b0586770f9c85e36e63/users/66fc34bcc13d48539e486db47cedcab1/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.383937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794fe0b68dcf4ced9125be94786be1bd, user_id=19410737ca1d477b8e5258d11f2ed33e, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.386584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.388581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64767f181b224b0586770f9c85e36e63, user_id=66fc34bcc13d48539e486db47cedcab1, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.391328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.455825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 758/1545] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:09 2021] PUT /identity/v3/projects/794fe0b68dcf4ced9125be94786be1bd/users/19410737ca1d477b8e5258d11f2ed33e/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:09.456736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.458284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:09.488542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 788/1546] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:09 2021] PUT /identity/v3/projects/64767f181b224b0586770f9c85e36e63/users/66fc34bcc13d48539e486db47cedcab1/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:09.489349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.520402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4199f-338d-4858-9787-78dfff42e587 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.548495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae879c4-8e11-4d32-8e15-e1dbf2e425f1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.553237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.554123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.554413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.554695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] PATH_INFO: `/v3/projects/eb85d6027d644d2db02c195215edc7ce/users/bb1699e5584746db88a9e7e693ca5600/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.566992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.567708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.567993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.568271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.568446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb85d6027d644d2db02c195215edc7ce, user_id=bb1699e5584746db88a9e7e693ca5600, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.571056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.577816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.579233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.588341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 759/1547] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:09.589117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.598232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705ca2-85b8-4335-b6a8-66f9a2121704 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.603104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.603972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.604254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.604564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] PATH_INFO: `/v3/projects/bd44df5f1089478c95dab66f0244a84d/users/2b716212224140038d211a75a5ee709f/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.618908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd44df5f1089478c95dab66f0244a84d, user_id=2b716212224140038d211a75a5ee709f, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.621699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.644678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 789/1548] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:09 2021] PUT /identity/v3/projects/eb85d6027d644d2db02c195215edc7ce/users/bb1699e5584746db88a9e7e693ca5600/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:09.648235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.704318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753dd0e-1dce-4f5c-8efb-7c90d14bba3a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.709013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.709827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.710112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.710388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] PATH_INFO: `/v3/projects/2ace662659514ac7a3311f550754142f/users/b7a79caa89e74f70b7ea321c44f2d582/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.725305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ace662659514ac7a3311f550754142f, user_id=b7a79caa89e74f70b7ea321c44f2d582, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.728116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.728733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 760/1549] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:09 2021] PUT /identity/v3/projects/bd44df5f1089478c95dab66f0244a84d/users/2b716212224140038d211a75a5ee709f/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:09.729864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.790655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ca961-b02b-4bb3-880c-41cb3239e429 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.795904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c5ae-f27e-4f3a-b7d4-c3b34e6aad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.796864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c5ae-f27e-4f3a-b7d4-c3b34e6aad93 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.797298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c5ae-f27e-4f3a-b7d4-c3b34e6aad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.808688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c5ae-f27e-4f3a-b7d4-c3b34e6aad93 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.808688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c5ae-f27e-4f3a-b7d4-c3b34e6aad93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.809461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 790/1550] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:09 2021] PUT /identity/v3/projects/2ace662659514ac7a3311f550754142f/users/b7a79caa89e74f70b7ea321c44f2d582/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:09.809461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:09.809655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c5ae-f27e-4f3a-b7d4-c3b34e6aad93 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.812564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 761/1551] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:09.814120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39007b4f-17ee-4945-8c04-6335fccf7dda None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.814440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39007b4f-17ee-4945-8c04-6335fccf7dda None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.814690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39007b4f-17ee-4945-8c04-6335fccf7dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.833254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-39007b4f-17ee-4945-8c04-6335fccf7dda None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:09.834455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-39007b4f-17ee-4945-8c04-6335fccf7dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:09.873881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84388dcb-2476-4f7f-9723-49dddf6a9f72 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:09.878832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a42e0-0770-4fb5-b8fd-7d0968338a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:09.879753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a42e0-0770-4fb5-b8fd-7d0968338a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.880041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a42e0-0770-4fb5-b8fd-7d0968338a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.880322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a42e0-0770-4fb5-b8fd-7d0968338a5f admin admin] PATH_INFO: `/v3/projects/7bbe3a05bcbe4a8c9e26d656fe5e250d/users/55444e3006684638a8d1c329eaba625f/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.891852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 762/1552] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:09.893548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbd34-e560-44a7-bca8-8da2dd8d07c0 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.894065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbd34-e560-44a7-bca8-8da2dd8d07c0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.894598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbd34-e560-44a7-bca8-8da2dd8d07c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:09.896678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a42e0-0770-4fb5-b8fd-7d0968338a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbe3a05bcbe4a8c9e26d656fe5e250d, user_id=55444e3006684638a8d1c329eaba625f, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:09.899616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a42e0-0770-4fb5-b8fd-7d0968338a5f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:09.921257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ae0dbd34-e560-44a7-bca8-8da2dd8d07c0 None None] MFA Rules not processed for user `66fc34bcc13d48539e486db47cedcab1`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:09.922795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ae0dbd34-e560-44a7-bca8-8da2dd8d07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:09.992564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 763/1553] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:09.992564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab6ab5-d0cc-4bcb-a55e-99c74f421f5c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:09.992564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab6ab5-d0cc-4bcb-a55e-99c74f421f5c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:09.992564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab6ab5-d0cc-4bcb-a55e-99c74f421f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.002342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 791/1554] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:09 2021] PUT /identity/v3/projects/7bbe3a05bcbe4a8c9e26d656fe5e250d/users/55444e3006684638a8d1c329eaba625f/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:10.004051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.004346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.004692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.014316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5cab6ab5-d0cc-4bcb-a55e-99c74f421f5c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:10.016876 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5cab6ab5-d0cc-4bcb-a55e-99c74f421f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:10.026813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:10.028637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:10.090852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 764/1555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:10.092049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 792/1556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:10.095339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.095339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.095339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.095613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.106097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f45d49-f332-45a5-8697-d4bffc2ddd84 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.111306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b700-1aa8-4514-aadb-186847e6c186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.112300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b700-1aa8-4514-aadb-186847e6c186 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.112612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b700-1aa8-4514-aadb-186847e6c186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.112902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b700-1aa8-4514-aadb-186847e6c186 admin admin] PATH_INFO: `/v3/projects/67015f6dc5314b809e00f9d78dbea0c6/users/eec0d636652646ca8461c4e926199a8a/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.122505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] MFA Rules not processed for user `b7a79caa89e74f70b7ea321c44f2d582`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:10.123719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:10.128392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b700-1aa8-4514-aadb-186847e6c186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67015f6dc5314b809e00f9d78dbea0c6, user_id=eec0d636652646ca8461c4e926199a8a, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.131239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b700-1aa8-4514-aadb-186847e6c186 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.185212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 765/1557] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:10.186121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.234369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 793/1558] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:10 2021] PUT /identity/v3/projects/67015f6dc5314b809e00f9d78dbea0c6/users/eec0d636652646ca8461c4e926199a8a/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:10.234369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc01d7-be20-4a4e-93d2-d6acec3f89a3 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.234369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc01d7-be20-4a4e-93d2-d6acec3f89a3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.234369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc01d7-be20-4a4e-93d2-d6acec3f89a3 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.241211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b440-7cf0-43c5-a3b2-a66f409c921c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.243000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 794/1559] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 14 22:25:10 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:10.244444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.244731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.245011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.265760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:10.267045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:10.299279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.299936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.300222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.300530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.332246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 795/1560] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:10.335044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.345083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17db4b-4a0b-4698-a84f-5fd312b17ec9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.348751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.349520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.349735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.350008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.359434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.360950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.367299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.368767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.370842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 796/1561] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:10.379203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 766/1562] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:10.381073 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.381864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.390076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed043-f01f-4c13-b5d4-6bc722d2a916 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.392754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c38121-5d51-4abe-9c4f-d5012e68f94b service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.393881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.394531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.394818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.395129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.403329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.404055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.404398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.407223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.407347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.407449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.408353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.409920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.421035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 797/1563] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:10.422060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.431519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab42-0110-490b-9df7-1bb512094f67 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.437302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e53eb-f0c2-4cae-a958-658a4439daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.438063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e53eb-f0c2-4cae-a958-658a4439daad admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.438351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e53eb-f0c2-4cae-a958-658a4439daad admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.438626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e53eb-f0c2-4cae-a958-658a4439daad admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.439454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e53eb-f0c2-4cae-a958-658a4439daad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.441362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e53eb-f0c2-4cae-a958-658a4439daad admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.451670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 798/1564] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:10.452716 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.453002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.453285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.470845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:10.472027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:10.522963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 767/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:10.523698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.541985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 799/1566] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:10.542612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.555449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f1c8-e35d-4d7f-9b0b-9a02fdbbe1bc None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.585748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3bb21-554b-488b-b227-914798b49da6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.589987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.595281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.595281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.595281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.615562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.616560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.616851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.617132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] PATH_INFO: `/v3/projects/67015f6dc5314b809e00f9d78dbea0c6/users/eec0d636652646ca8461c4e926199a8a/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.619156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67015f6dc5314b809e00f9d78dbea0c6, user_id=eec0d636652646ca8461c4e926199a8a, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.622628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.633972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 800/1567] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:10 2021] PUT /identity/v3/projects/67015f6dc5314b809e00f9d78dbea0c6/users/eec0d636652646ca8461c4e926199a8a/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:10.634756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.664774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.666653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.676625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 768/1568] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:10.677776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.705753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd1f82-b1c2-4575-b02e-2c1f50c7722a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.711183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23cccf-5ff7-4066-ab32-839050cf6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.712018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cccf-5ff7-4066-ab32-839050cf6fad admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.712709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cccf-5ff7-4066-ab32-839050cf6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.713093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cccf-5ff7-4066-ab32-839050cf6fad admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.713887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23cccf-5ff7-4066-ab32-839050cf6fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.715981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23cccf-5ff7-4066-ab32-839050cf6fad admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.745599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0080a-e30b-4a7d-96a0-f1caac7bdada service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.799147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 801/1569] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:10.799147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.799147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.799147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.813160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.814947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.814947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.814947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.827596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] MFA Rules not processed for user `eec0d636652646ca8461c4e926199a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:10.828859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:10.873296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.875823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.884777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 769/1570] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:10.895658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.916920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed63a2-5243-4bfd-9a84-c6565af3ca4c service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.925164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.926050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.926518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.927197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.928761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.931111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:10.942806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 770/1571] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:10.947328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.951001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 802/1572] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:10 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:10.960919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916fb6-3258-4c0d-b80c-8530bc1caddf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:10.966730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ee792-1dde-4ac4-9b60-59367e14fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:10.967645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ee792-1dde-4ac4-9b60-59367e14fb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:10.967934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ee792-1dde-4ac4-9b60-59367e14fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:10.968214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ee792-1dde-4ac4-9b60-59367e14fb49 admin admin] PATH_INFO: `/v3/projects/20cc4adfa61a4123897d2ae0333b92b7/users/d6b43f6cd68548c4909991ebd5ea5a85/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:10.968649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:10.985995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ee792-1dde-4ac4-9b60-59367e14fb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cc4adfa61a4123897d2ae0333b92b7, user_id=d6b43f6cd68548c4909991ebd5ea5a85, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:10.989450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ee792-1dde-4ac4-9b60-59367e14fb49 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.029769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011fb1b-0bed-46e6-961c-285a12e8b5a6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:11.033318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:11.034999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.034999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.034999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.044017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:11.045502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.055307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 803/1573] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:10 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:11.101778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:11.102302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 771/1574] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:10 2021] PUT /identity/v3/projects/20cc4adfa61a4123897d2ae0333b92b7/users/d6b43f6cd68548c4909991ebd5ea5a85/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:11.115217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacdaf2-b2ea-487e-b68a-c58864a68915 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:11.132245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523c2c-f46b-4d60-b9b7-2b2024d02725 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.132564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523c2c-f46b-4d60-b9b7-2b2024d02725 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.132969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523c2c-f46b-4d60-b9b7-2b2024d02725 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.135106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 772/1575] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 14 22:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:11.135831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523c2c-f46b-4d60-b9b7-2b2024d02725 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:11.235558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3d06-3e64-4393-a5d5-5b4bd7ec99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:11.240453 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3d06-3e64-4393-a5d5-5b4bd7ec99ea admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.241120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3d06-3e64-4393-a5d5-5b4bd7ec99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.241500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3d06-3e64-4393-a5d5-5b4bd7ec99ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.244763 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3d06-3e64-4393-a5d5-5b4bd7ec99ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:11.246593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3d06-3e64-4393-a5d5-5b4bd7ec99ea admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.247963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523c2c-f46b-4d60-b9b7-2b2024d02725 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:11.251990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:11.252745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.253035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.253453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.263152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 804/1576] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:11 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:11.265646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.266131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.266582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.300457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:11.301698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:11.321412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:11.323210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.335948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 773/1577] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:11 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:11.337354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:11.354152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785f1b3-2a69-4bf7-a214-706dff0cb0c6 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:11.360039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b61b-76af-49e7-8f63-4ef9a02e35ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:11.361339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b61b-76af-49e7-8f63-4ef9a02e35ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.361799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b61b-76af-49e7-8f63-4ef9a02e35ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.362269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b61b-76af-49e7-8f63-4ef9a02e35ce admin admin] PATH_INFO: `/v3/projects/20cc4adfa61a4123897d2ae0333b92b7/users/d6b43f6cd68548c4909991ebd5ea5a85/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.364618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b61b-76af-49e7-8f63-4ef9a02e35ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cc4adfa61a4123897d2ae0333b92b7, user_id=d6b43f6cd68548c4909991ebd5ea5a85, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:11.368088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b61b-76af-49e7-8f63-4ef9a02e35ce admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.394703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 774/1578] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:11 2021] PUT /identity/v3/projects/20cc4adfa61a4123897d2ae0333b92b7/users/d6b43f6cd68548c4909991ebd5ea5a85/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:11.396477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.396783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.397069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.403267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 805/1579] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:25:11 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:11.421616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:11.431947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb59e1-c999-4749-8b9f-2bad2ff690d2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:11.477011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] MFA Rules not processed for user `d6b43f6cd68548c4909991ebd5ea5a85`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:11.483817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:11.487246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d387d-bcf1-4207-95dc-e24b9eaf8b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:11.488029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d387d-bcf1-4207-95dc-e24b9eaf8b45 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.488378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d387d-bcf1-4207-95dc-e24b9eaf8b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.488648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d387d-bcf1-4207-95dc-e24b9eaf8b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.582746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d387d-bcf1-4207-95dc-e24b9eaf8b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:11.587078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d387d-bcf1-4207-95dc-e24b9eaf8b45 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.587343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 775/1580] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:11 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:11.587343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:11.616292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 806/1581] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:11.704112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cd221-ca10-4699-a165-aef0d69d1fb6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:11.711820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:11.712771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:11.713060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:11.713339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] PATH_INFO: `/v3/users/b7a79caa89e74f70b7ea321c44f2d582` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:11.716940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a79caa89e74f70b7ea321c44f2d582)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:11.719073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:11.968782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a79caa89e74f70b7ea321c44f2d582'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:11.970204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a79caa89e74f70b7ea321c44f2d582'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:11.971029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a79caa89e74f70b7ea321c44f2d582'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:12.065486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a79caa89e74f70b7ea321c44f2d582'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:12.080759 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a79caa89e74f70b7ea321c44f2d582'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:12.097411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 776/1582] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:11 2021] DELETE /identity/v3/users/b7a79caa89e74f70b7ea321c44f2d582 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:12.102272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a597a-8858-4e8a-a9cb-6f48108cbce3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:12.102732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a597a-8858-4e8a-a9cb-6f48108cbce3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:12.103010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a597a-8858-4e8a-a9cb-6f48108cbce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:12.138242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-941a597a-8858-4e8a-a9cb-6f48108cbce3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:12.139428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-941a597a-8858-4e8a-a9cb-6f48108cbce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:12.225720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 807/1583] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:12.249042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:12.250350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:12.309827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db5be1-cca7-408c-a34e-fb428452c91a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:12.313727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15747190-6b68-495a-b33f-83d77b3b4a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:12.314414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747190-6b68-495a-b33f-83d77b3b4a3e service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:12.314698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747190-6b68-495a-b33f-83d77b3b4a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:12.314969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15747190-6b68-495a-b33f-83d77b3b4a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:12.327906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15747190-6b68-495a-b33f-83d77b3b4a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:12.327906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15747190-6b68-495a-b33f-83d77b3b4a3e service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:12.336452 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 777/1584] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:13.340478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415949d-5456-4f03-a7cc-b9e15e72fe8f None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:13.340971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415949d-5456-4f03-a7cc-b9e15e72fe8f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:13.341068 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415949d-5456-4f03-a7cc-b9e15e72fe8f None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:13.343351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 808/1585] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 14 22:25:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:13.354527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821eacb-edde-45f4-82ca-2a31827c42a5 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:13.354989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821eacb-edde-45f4-82ca-2a31827c42a5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:13.355084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821eacb-edde-45f4-82ca-2a31827c42a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:13.382305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f821eacb-edde-45f4-82ca-2a31827c42a5 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:13.384328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f821eacb-edde-45f4-82ca-2a31827c42a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:13.515220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 778/1586] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 14 22:25:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:13.521392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88eb6d-adbf-4034-b3b2-7b9b4d23135b None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:13.521922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88eb6d-adbf-4034-b3b2-7b9b4d23135b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:13.522204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88eb6d-adbf-4034-b3b2-7b9b4d23135b None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:13.524097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 809/1587] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 14 22:25:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:13.531421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:13.531886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:13.532180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:13.558493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:13.559804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:13.585570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 779/1588] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:25:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:13.600121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88eb6d-adbf-4034-b3b2-7b9b4d23135b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:13.603365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0a88eb6d-adbf-4034-b3b2-7b9b4d23135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:13.746545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88eb6d-adbf-4034-b3b2-7b9b4d23135b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:13.752105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cfd5e-cb0b-48c7-bca9-925a117c0bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:13.753416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cfd5e-cb0b-48c7-bca9-925a117c0bfd service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:13.753699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cfd5e-cb0b-48c7-bca9-925a117c0bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:13.753986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cfd5e-cb0b-48c7-bca9-925a117c0bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:13.769929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cfd5e-cb0b-48c7-bca9-925a117c0bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:13.771771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cfd5e-cb0b-48c7-bca9-925a117c0bfd service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:13.787495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 810/1589] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:14.042194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:14.044121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:14.059147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14477-c9d1-4940-ad15-007500878791 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:14.059448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14477-c9d1-4940-ad15-007500878791 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:14.061090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14477-c9d1-4940-ad15-007500878791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:14.084857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ca36-f652-41a2-907c-a15d816f4f1c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:14.098729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:14.100177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:14.100177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:14.100177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] PATH_INFO: `/v3/projects/2ace662659514ac7a3311f550754142f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:14.102969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ace662659514ac7a3311f550754142f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:14.104102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: WARNING py.warnings [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:25:14.104102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: warnings.warn(msg) Sep 14 22:25:14.104102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: Sep 14 22:25:14.106044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:14.108295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1ba14477-c9d1-4940-ad15-007500878791 None None] MFA Rules not processed for user `bb1699e5584746db88a9e7e693ca5600`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:14.110908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1ba14477-c9d1-4940-ad15-007500878791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:14.219921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 811/1590] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:14.236685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:14.237225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:14.237894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:14.259414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] MFA Rules not processed for user `bb1699e5584746db88a9e7e693ca5600`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:14.260905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:14.269611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 812/1591] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:14.281168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:14.282794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:14.312444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42684ee-4382-40d4-8857-9710150a8ffd None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:14.331217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ace662659514ac7a3311f550754142f', 'request_id': 'req-74890835-7cb9-4118-ad1a-8e4518df5b4d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.339554 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ace662659514ac7a3311f550754142f', 'request_id': 'req-74890835-7cb9-4118-ad1a-8e4518df5b4d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.356030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ace662659514ac7a3311f550754142f', 'request_id': 'req-74890835-7cb9-4118-ad1a-8e4518df5b4d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.401116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca8ce-2a62-4fe2-93c1-f34a9d52ea5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:14.402474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca8ce-2a62-4fe2-93c1-f34a9d52ea5b service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:14.402941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca8ce-2a62-4fe2-93c1-f34a9d52ea5b service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:14.403365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca8ce-2a62-4fe2-93c1-f34a9d52ea5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:14.437062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] The token cache is being invalidate because project 2ace662659514ac7a3311f550754142f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:14.437615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.438445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.440487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 780/1592] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:14 2021] DELETE /identity/v3/projects/2ace662659514ac7a3311f550754142f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:14.444569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:14.446173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:14.482699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca8ce-2a62-4fe2-93c1-f34a9d52ea5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:14.484558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca8ce-2a62-4fe2-93c1-f34a9d52ea5b service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:14.497151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 813/1593] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:14.554241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74890835-7cb9-4118-ad1a-8e4518df5b4d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:14.564623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:14.565642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:14.566218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:14.566653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] PATH_INFO: `/v3/users/d6b43f6cd68548c4909991ebd5ea5a85` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:14.568302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b43f6cd68548c4909991ebd5ea5a85)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:14.570768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:14.758981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b43f6cd68548c4909991ebd5ea5a85'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.759991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b43f6cd68548c4909991ebd5ea5a85'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.760795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b43f6cd68548c4909991ebd5ea5a85'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.850253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b43f6cd68548c4909991ebd5ea5a85'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.888617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bb65340a-dd24-40de-b182-1d9b18085523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b43f6cd68548c4909991ebd5ea5a85'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:14.922035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 781/1594] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:14 2021] DELETE /identity/v3/users/d6b43f6cd68548c4909991ebd5ea5a85 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:14.980225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3662-d7ab-473c-a43f-2706025d83b1 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:14.982527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3662-d7ab-473c-a43f-2706025d83b1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:14.983058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3662-d7ab-473c-a43f-2706025d83b1 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:14.985008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 814/1595] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 14 22:25:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:15.000069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e85a-3dcf-427f-9fbe-26d339e9527b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:15.000748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e85a-3dcf-427f-9fbe-26d339e9527b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:15.001417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e85a-3dcf-427f-9fbe-26d339e9527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:15.040788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3954e85a-3dcf-427f-9fbe-26d339e9527b None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:15.044978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3954e85a-3dcf-427f-9fbe-26d339e9527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:15.202324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 782/1596] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:25:14 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:15.214634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3662-d7ab-473c-a43f-2706025d83b1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:15.216941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c95e3662-d7ab-473c-a43f-2706025d83b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:15.258156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3662-d7ab-473c-a43f-2706025d83b1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:15.258156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:15.258156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:15.258156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:15.259384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:15.269204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:15.271681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:15.296036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 815/1597] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:15 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:15.637079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fccac-8b37-48fc-a39d-752296df6b90 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:15.637677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fccac-8b37-48fc-a39d-752296df6b90 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:15.638068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fccac-8b37-48fc-a39d-752296df6b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:15.698008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-779fccac-8b37-48fc-a39d-752296df6b90 None None] MFA Rules not processed for user `19410737ca1d477b8e5258d11f2ed33e`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:15.699283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-779fccac-8b37-48fc-a39d-752296df6b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:15.759050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:15.760772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:15.808401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 783/1598] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:15.811183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:15.812668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:15.813525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:15.835736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] MFA Rules not processed for user `19410737ca1d477b8e5258d11f2ed33e`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:15.839781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:15.852034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 784/1599] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:15.865947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:15.867608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:15.946312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb245a-d091-4119-b5b0-36c058cedf58 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:15.959506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:15.960411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:15.960817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:15.961083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] PATH_INFO: `/v3/projects/20cc4adfa61a4123897d2ae0333b92b7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:15.965267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cc4adfa61a4123897d2ae0333b92b7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:15.967316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.027804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c18bbd-107d-4e2a-aa03-7a1911e536ce None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:16.034889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8478da6-8589-402f-a862-d35bb43bb7ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:16.035606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8478da6-8589-402f-a862-d35bb43bb7ff service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.036447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8478da6-8589-402f-a862-d35bb43bb7ff service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.036447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8478da6-8589-402f-a862-d35bb43bb7ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.048450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8478da6-8589-402f-a862-d35bb43bb7ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:16.050758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8478da6-8589-402f-a862-d35bb43bb7ff service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.085727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 785/1600] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:16.133651 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cc4adfa61a4123897d2ae0333b92b7', 'request_id': 'req-75e47794-5f1f-4935-9447-8e4e8539a180'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:16.142015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cc4adfa61a4123897d2ae0333b92b7', 'request_id': 'req-75e47794-5f1f-4935-9447-8e4e8539a180'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:16.154165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cc4adfa61a4123897d2ae0333b92b7', 'request_id': 'req-75e47794-5f1f-4935-9447-8e4e8539a180'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:16.266927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] The token cache is being invalidate because project 20cc4adfa61a4123897d2ae0333b92b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:16.267419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:16.268561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-75e47794-5f1f-4935-9447-8e4e8539a180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:16.270588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 816/1601] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:15 2021] DELETE /identity/v3/projects/20cc4adfa61a4123897d2ae0333b92b7 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:16.275971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.276369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.276818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.307901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:16.309763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:16.401381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 786/1602] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:16.409886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.410180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.410465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.430109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:16.431336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:16.440332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 817/1603] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:16.444738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:16.457335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518d608-a08c-406b-a7e6-a7f0bb7da020 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:16.476089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:16.476089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.476445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.476744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.477503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:16.477823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:16.480991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb3948-9366-4d59-b35f-72ae54a6a6a6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.505673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 787/1604] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:16.509719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:16.521403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b04b3f-fa17-4b4a-b34c-cc091c7b3ad3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:16.528836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144f15d-b042-4df0-8ff1-9df2d13396e8 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.529393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144f15d-b042-4df0-8ff1-9df2d13396e8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.529982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144f15d-b042-4df0-8ff1-9df2d13396e8 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.532827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 788/1605] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 14 22:25:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 22:25:16.538159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:16.538949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.539131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.539411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.540185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:16.542257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.554738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.555911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.556887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.603078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:16.604360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:16.654759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 818/1606] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:16 2021] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:16.655475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:16.659048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:16.734298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 789/1607] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:25:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:16.735239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:16.747898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90745e9-d1c3-4367-99d6-664cb38f2f3a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:16.770025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6987d1-ef08-49f9-bf4a-159c32d34afc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:16.776277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:16.777709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.779010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.779010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.785655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:16.802618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:16.804487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.822625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 819/1608] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:16 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:16.824619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:16.826229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:16.846129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:16.847905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.849552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.850029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.851391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:16.853604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.920105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87971ead-fbba-4640-bc7e-ca6027d8e47f service placement] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:16.925757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:16.926696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:16.927082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:16.927472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] PATH_INFO: `/v3/users/66fc34bcc13d48539e486db47cedcab1` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:16.928714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fc34bcc13d48539e486db47cedcab1)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:16.933029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: WARNING py.warnings [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 22:25:16.933029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: warnings.warn(msg) Sep 14 22:25:16.933029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: Sep 14 22:25:16.935247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:16.942279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 790/1609] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:16 2021] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:16.943025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:16.944776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:17.023946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e3a17-cdb7-4525-abee-6134e06fd7f9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.027893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.028604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.028890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.029171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.038358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.040323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:17.052526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 791/1610] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:17.053515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:17.071819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393b27-0517-4eb0-9bf1-a736cf62f46a service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.077541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.078502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.078621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.078875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.079685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.081624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:17.096262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 792/1611] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:17 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:17.100134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:17.114364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd72b0-ec4a-4bc8-a034-4dbdceb0fe4d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.121227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.122261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.128324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.128324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.128324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.128324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:17.139263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 793/1612] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:17 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:17.143871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:17.189640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b076a3-8bee-4882-9b66-91f96481830f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.201192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6ce5c-e870-4c9b-b487-8d2da143d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.201192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6ce5c-e870-4c9b-b487-8d2da143d899 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.201192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6ce5c-e870-4c9b-b487-8d2da143d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.201539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6ce5c-e870-4c9b-b487-8d2da143d899 admin admin] PATH_INFO: `/v3/projects/94c20071890e4dc8a0dd4a5e6c844cb4/users/56afcbef68cd456db34b3e0abd09e478/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.220974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fc34bcc13d48539e486db47cedcab1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:17.249188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6ce5c-e870-4c9b-b487-8d2da143d899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c20071890e4dc8a0dd4a5e6c844cb4, user_id=56afcbef68cd456db34b3e0abd09e478, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.252614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6ce5c-e870-4c9b-b487-8d2da143d899 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:17.358857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fc34bcc13d48539e486db47cedcab1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:17.365796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 794/1613] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:17 2021] PUT /identity/v3/projects/94c20071890e4dc8a0dd4a5e6c844cb4/users/56afcbef68cd456db34b3e0abd09e478/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:17.378584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.378884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.379196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.403160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fc34bcc13d48539e486db47cedcab1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:17.428030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fc34bcc13d48539e486db47cedcab1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:17.434972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe344f65-581e-480a-95a3-45b94cb86e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fc34bcc13d48539e486db47cedcab1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:17.439842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] MFA Rules not processed for user `56afcbef68cd456db34b3e0abd09e478`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:17.442142 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:17.446519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 820/1614] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:16 2021] DELETE /identity/v3/users/66fc34bcc13d48539e486db47cedcab1 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:17.451890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.452231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.452501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.489608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:17.490870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:17.576740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 795/1615] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:17 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:17.581278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:17.583905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:17.644567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 821/1616] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:17.651550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:17.653544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:17.671433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902096fc-1fbc-41f7-8260-7e127a323a0e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.676849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.679503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.679808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.680084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.680827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.687033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:17.791960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851534d0-06d0-48af-a557-01a8479552a4 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.810331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 796/1617] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:17 2021] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:17.814218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:17.822518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.823214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.823553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.823838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.875643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.879770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:17.924357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 822/1618] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:17.970614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a90e0-c6a2-48f9-905f-12ec19a77940 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:17.976598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:17.977476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:17.977970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:17.978416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:17.979565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:17.982896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:18.084888 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 797/1619] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:17 2021] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:18.090036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:18.103705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46266c1d-7813-4e31-913b-297aacbafacd service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:18.121467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:18.122171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:18.122460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:18.126022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:18.131821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:18.136013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:18.160110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 823/1620] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:18 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:18.164227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:18.176118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3c677-227d-41a8-ba62-7ed7d61cb422 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:18.193580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:18.193580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:18.193580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:18.193580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] PATH_INFO: `/v3/projects/0b6c005d58dc4878a7ad752af07435b7/users/b48d336cfca94b09a22fc46656e9773c/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:18.217234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c005d58dc4878a7ad752af07435b7, user_id=b48d336cfca94b09a22fc46656e9773c, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:18.222288 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:18.465399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 798/1621] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:18 2021] PUT /identity/v3/projects/0b6c005d58dc4878a7ad752af07435b7/users/b48d336cfca94b09a22fc46656e9773c/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:18.466743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:18.477063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c132578-b4b2-4fd2-86db-43341dee1dd0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:18.609983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697da96e-e89c-4ff7-89a2-cc28fa1b0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:18.610898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697da96e-e89c-4ff7-89a2-cc28fa1b0bbe admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:18.611320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697da96e-e89c-4ff7-89a2-cc28fa1b0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:18.611754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697da96e-e89c-4ff7-89a2-cc28fa1b0bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:18.613045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697da96e-e89c-4ff7-89a2-cc28fa1b0bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:18.616227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697da96e-e89c-4ff7-89a2-cc28fa1b0bbe admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:18.634911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 824/1622] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:18 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:18.636122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:18.657042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba0382-07b1-4bf1-a78c-a209db97d6ff admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:18.673744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:18.674484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:18.674764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:18.675030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] PATH_INFO: `/v3/projects/0b6c005d58dc4878a7ad752af07435b7/users/b48d336cfca94b09a22fc46656e9773c/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:18.679632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c005d58dc4878a7ad752af07435b7, user_id=b48d336cfca94b09a22fc46656e9773c, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:18.682653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:18.721572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 799/1623] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:18 2021] PUT /identity/v3/projects/0b6c005d58dc4878a7ad752af07435b7/users/b48d336cfca94b09a22fc46656e9773c/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:18.775323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:18.776074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:18.776652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:18.799754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:18.802049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:18.841500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] MFA Rules not processed for user `b48d336cfca94b09a22fc46656e9773c`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:18.843890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:18.923924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f863-5533-4e0c-8198-9c67f32c2480 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:18.931022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:18.932413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:18.936325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:18.936325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] PATH_INFO: `/v3/users/2a2c44ef949e40029785026e27f77bb2` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:18.936325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2c44ef949e40029785026e27f77bb2)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:18.937348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:19.002446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 825/1624] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:18 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:19.022509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:19.023673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:19.153464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2c44ef949e40029785026e27f77bb2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.153572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2c44ef949e40029785026e27f77bb2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.155045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2c44ef949e40029785026e27f77bb2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.232090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2c44ef949e40029785026e27f77bb2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.255835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d7330-5458-41af-ad4d-12505df1ec04 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:19.283894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:19.284688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:19.284984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:19.285266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:19.289194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:19.294474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2c44ef949e40029785026e27f77bb2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.313461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:19.314917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154d2a-877f-4de9-815b-407713a4deb6 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:19.319117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 800/1625] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:18 2021] DELETE /identity/v3/users/2a2c44ef949e40029785026e27f77bb2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:19.321726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:19.323415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:19.340033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 826/1626] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:19 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:19.361495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:19.363370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:19.363370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:19.420770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:19.421108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:19.541839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 827/1627] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:19.560897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:19.562699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:19.610798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339230c-2e67-4f62-abf5-f38c1ab58e91 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:19.625980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:19.627708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:19.627912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:19.628473 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] PATH_INFO: `/v3/projects/64767f181b224b0586770f9c85e36e63` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:19.633548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64767f181b224b0586770f9c85e36e63)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:19.637384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:19.681881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b7304-9ec9-4e29-93b6-9e8d6deff2c8 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:19.683152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121e290-be0d-4554-b5f4-25627ea8bf37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:19.683925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e290-be0d-4554-b5f4-25627ea8bf37 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:19.684313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e290-be0d-4554-b5f4-25627ea8bf37 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:19.684735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121e290-be0d-4554-b5f4-25627ea8bf37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:19.712309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121e290-be0d-4554-b5f4-25627ea8bf37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:19.713896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121e290-be0d-4554-b5f4-25627ea8bf37 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:19.736126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 828/1628] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:19.846695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64767f181b224b0586770f9c85e36e63', 'request_id': 'req-294568be-5988-4d19-a433-2d26d03f1b48'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.919384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64767f181b224b0586770f9c85e36e63', 'request_id': 'req-294568be-5988-4d19-a433-2d26d03f1b48'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:19.940740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64767f181b224b0586770f9c85e36e63', 'request_id': 'req-294568be-5988-4d19-a433-2d26d03f1b48'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:20.056540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] The token cache is being invalidate because project 64767f181b224b0586770f9c85e36e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:20.056841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:20.057519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-294568be-5988-4d19-a433-2d26d03f1b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:20.059908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 801/1629] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:19 2021] DELETE /identity/v3/projects/64767f181b224b0586770f9c85e36e63 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:20.065339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:20.065919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:20.066092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:20.120974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:20.128630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:20.278619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 829/1630] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:20.286726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:20.287084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:20.287415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:20.311151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:20.312839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:20.326252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 802/1631] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:20.335168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:20.347394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138fc91-d1fd-44f7-b60d-3301769d1eca None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:20.360207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:20.361713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:20.361713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:20.362468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:20.363113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:20.364009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:20.365578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:20.391037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 830/1632] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:20.395432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:20.420397 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a28a8-53e2-4713-92de-6caea2874893 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:20.433396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:20.437485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:20.437634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:20.438078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:20.438976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:20.442892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:20.551385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:20.556862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:20.567104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 803/1633] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:20 2021] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:20.570112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:20.604814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc079-4604-4597-aec1-51f7c545f6c1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:20.792099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38711-9844-44f1-9745-7b01f1a097fc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:20.793701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:20.794682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:20.795034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:20.795374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] PATH_INFO: `/v3/users/56afcbef68cd456db34b3e0abd09e478` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:20.797277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56afcbef68cd456db34b3e0abd09e478)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:20.800356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:20.809749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:20.814305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:20.814305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:20.814305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:20.814305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:20.816392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:20.938245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 804/1634] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:20 2021] POST /identity/v3/users => generated 294 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:20.942740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:20.987394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8af98-18f1-4f43-b0e6-afb758d17c93 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:21.005628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:21.005628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.005628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.005628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.006076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:21.006796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:21.030313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 805/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:20 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:21.035694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:21.067523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bce85-c63b-47b6-8c92-bfd50a471029 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:21.080801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56afcbef68cd456db34b3e0abd09e478'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:21.086598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:21.088668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.088966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.090827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.092452 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:21.098094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:21.139225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 806/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:21 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:21.144756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:21.176030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56afcbef68cd456db34b3e0abd09e478'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:21.199115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f01ba-b766-4868-b934-6749f4c6bcc6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:21.200086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56afcbef68cd456db34b3e0abd09e478'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:21.218796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56afcbef68cd456db34b3e0abd09e478'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:21.221122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-59c2e96a-9fa9-41cc-9cb8-60b263060572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56afcbef68cd456db34b3e0abd09e478'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:21.223110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:21.224611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.224611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.224829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] PATH_INFO: `/v3/projects/4c5244ebdd8f46deb2fd98e6d5517fe1/users/94860e02919546a4b43b08fd02744a25/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.239318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 831/1637] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:20 2021] DELETE /identity/v3/users/56afcbef68cd456db34b3e0abd09e478 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:21.241582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39778c-a6cb-4a8d-be8b-36dafaf27d52 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.242093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39778c-a6cb-4a8d-be8b-36dafaf27d52 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.242538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39778c-a6cb-4a8d-be8b-36dafaf27d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.277112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5244ebdd8f46deb2fd98e6d5517fe1, user_id=94860e02919546a4b43b08fd02744a25, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:21.279879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:21.286987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6f39778c-a6cb-4a8d-be8b-36dafaf27d52 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:21.288819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6f39778c-a6cb-4a8d-be8b-36dafaf27d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:21.391080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 832/1638] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:21.401578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 807/1639] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:21 2021] PUT /identity/v3/projects/4c5244ebdd8f46deb2fd98e6d5517fe1/users/94860e02919546a4b43b08fd02744a25/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:21.415776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.416127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.416342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.453305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:21.454981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:21.476978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] MFA Rules not processed for user `94860e02919546a4b43b08fd02744a25`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:21.480940 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:21.601172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064c12c-ab41-4592-88b3-a45eff3b1d6c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:21.617593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:21.618301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.618609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.618881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.702764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 833/1640] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:21 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:21.708201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:21.713293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:21.819753 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:21.822140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:21.846409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 808/1641] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:21.923791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5bff-0738-4e41-8070-92dda05a5290 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:21.934325 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:21.935047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:21.944030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:21.944030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:21.944030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:21.944030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:22.065984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 834/1642] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:21 2021] POST /identity/v3/projects => generated 385 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:22.075865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:22.099564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ba640-9257-4c1a-8c52-509e76e8817a service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:22.219797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:22.220628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:22.220984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:22.221433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:22.222455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:22.224649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:22.360481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 809/1643] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:22 2021] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:22.364590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:22.395894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4f081-1920-4b08-9c7e-f37547e0aaa8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:22.412232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:22.413011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:22.413300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:22.413639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:22.414387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:22.418215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:22.443192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 835/1644] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:22 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:22.447636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:22.461030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f02ea-ff3d-4a46-a846-11ca64706f23 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:22.473652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fe21e-b1b9-4412-a863-6793649d5380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:22.477008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe21e-b1b9-4412-a863-6793649d5380 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:22.477008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe21e-b1b9-4412-a863-6793649d5380 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:22.477008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe21e-b1b9-4412-a863-6793649d5380 admin admin] PATH_INFO: `/v3/projects/4a510e0aba3746a7a9432cf28913417d/users/7653c037425e44b2a8321234692b1a1b/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:22.507723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:22.509578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:22.522619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fe21e-b1b9-4412-a863-6793649d5380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a510e0aba3746a7a9432cf28913417d, user_id=7653c037425e44b2a8321234692b1a1b, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:22.528302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fe21e-b1b9-4412-a863-6793649d5380 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:22.539143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d112-0efc-4b2c-92e2-54fa6a1aa278 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:22.556254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:22.557291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:22.557291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:22.557654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] PATH_INFO: `/v3/projects/bdd7aa5bf21343faa752259d5016158e` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:22.561411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd7aa5bf21343faa752259d5016158e)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:22.563350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:22.612911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 810/1645] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:22 2021] PUT /identity/v3/projects/4a510e0aba3746a7a9432cf28913417d/users/7653c037425e44b2a8321234692b1a1b/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:22.614579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:22.615255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:22.615255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:22.676151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:22.678073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:22.766723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 811/1646] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:25:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:22.767880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:22.812957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd7aa5bf21343faa752259d5016158e', 'request_id': 'req-51690f3c-b6fa-4fee-bf66-27f9a032e232'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:22.840362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd7aa5bf21343faa752259d5016158e', 'request_id': 'req-51690f3c-b6fa-4fee-bf66-27f9a032e232'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:22.857188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd7aa5bf21343faa752259d5016158e', 'request_id': 'req-51690f3c-b6fa-4fee-bf66-27f9a032e232'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:22.893032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04c69-9a81-4ab5-b3af-220ce5ced2d2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:22.994618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] The token cache is being invalidate because project bdd7aa5bf21343faa752259d5016158e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:22.995256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:22.997057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-51690f3c-b6fa-4fee-bf66-27f9a032e232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:23.000611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 836/1647] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:22 2021] DELETE /identity/v3/projects/bdd7aa5bf21343faa752259d5016158e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:23.005598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.008081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.008634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.016971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:23.018451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.018740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.019019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.046640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:23.046640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:23.067963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 812/1648] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:22 2021] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:23.069600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:23.078198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.117943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] MFA Rules not processed for user `d8252f18c467437699c3fb15f28ff9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:23.119319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.128250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eab01-1be8-4b79-a3df-9f481eac5a29 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:23.144237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:23.149912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.153584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.156840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] PATH_INFO: `/v3/users/eec0d636652646ca8461c4e926199a8a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.158352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec0d636652646ca8461c4e926199a8a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:23.175733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:23.328626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 837/1649] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:23 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:23.339888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:23.349359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.392138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f7daf-62dc-4268-a049-fa2291de618a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:23.403603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec0d636652646ca8461c4e926199a8a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:23.406230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:23.406649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec0d636652646ca8461c4e926199a8a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:23.407540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.407991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.408437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] PATH_INFO: `/v3/projects/4a510e0aba3746a7a9432cf28913417d/users/7653c037425e44b2a8321234692b1a1b/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.408555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec0d636652646ca8461c4e926199a8a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:23.410788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a510e0aba3746a7a9432cf28913417d, user_id=7653c037425e44b2a8321234692b1a1b, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:23.414566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:23.460136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 838/1650] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:23 2021] PUT /identity/v3/projects/4a510e0aba3746a7a9432cf28913417d/users/7653c037425e44b2a8321234692b1a1b/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:23.460136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:23.462588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.862080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec0d636652646ca8461c4e926199a8a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:23.862080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec0d636652646ca8461c4e926199a8a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:23.867159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e625be9-8b48-457e-b31f-9e2b1d0d0521 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:23.867159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:23.867159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.867159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.871843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.871843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.874399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 813/1651] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:23 2021] DELETE /identity/v3/users/eec0d636652646ca8461c4e926199a8a => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:23.874399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:23.874399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.875357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:23.875357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2239e2-8c65-45ff-8428-99806fb83286 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:23.875357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 839/1652] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:25:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:25:23.875357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.875357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.875357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.921691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c255be-472c-4f6a-a164-3e43718e0b31 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:23.944119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:23.945092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:23.945530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:23.950929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] MFA Rules not processed for user `7653c037425e44b2a8321234692b1a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:23.952192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:23.954706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:23.957353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:24.086484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:24.090212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:24.110222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 814/1653] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:23 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:24.329429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 840/1654] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:23 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:24.405653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:24.411614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:24.672670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4490aa-2da2-44e6-8393-cd3413c6fd95 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:24.695297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:24.696020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:24.696309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:24.699784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:24.731842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:24.734543 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:24.756599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 815/1655] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:24 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:25.291566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:25.293391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:25.525070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26ea8-79ab-42aa-a94a-6d431fcdfd78 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:25.531897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:25.533378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:25.533828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:25.534354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] PATH_INFO: `/v3/users/94860e02919546a4b43b08fd02744a25` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:25.535790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94860e02919546a4b43b08fd02744a25)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:25.540007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:25.786336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:25.791423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:25.813719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94585ca-321d-4de8-a310-8b72f7104d6d service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:25.825273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:25.828677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:25.829520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:25.830137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] PATH_INFO: `/v3/projects/94c20071890e4dc8a0dd4a5e6c844cb4` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:25.840241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94860e02919546a4b43b08fd02744a25'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:25.848988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c20071890e4dc8a0dd4a5e6c844cb4)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:25.852841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:25.921331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94860e02919546a4b43b08fd02744a25'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:25.943918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94860e02919546a4b43b08fd02744a25'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:25.959629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94860e02919546a4b43b08fd02744a25'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:25.967881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8d3976af-2c58-4b96-b985-5d3cac23290f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94860e02919546a4b43b08fd02744a25'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:25.978517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 841/1656] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:25 2021] DELETE /identity/v3/users/94860e02919546a4b43b08fd02744a25 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:25.980739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:25.980948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:25.981321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:26.022895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:26.024299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:26.026659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c20071890e4dc8a0dd4a5e6c844cb4', 'request_id': 'req-01262f6f-fa55-4e56-b8bc-079b92103645'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.033731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c20071890e4dc8a0dd4a5e6c844cb4', 'request_id': 'req-01262f6f-fa55-4e56-b8bc-079b92103645'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.044624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c20071890e4dc8a0dd4a5e6c844cb4', 'request_id': 'req-01262f6f-fa55-4e56-b8bc-079b92103645'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.136446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] The token cache is being invalidate because project 94c20071890e4dc8a0dd4a5e6c844cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:26.136446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.136446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.139041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 816/1657] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:25 2021] DELETE /identity/v3/projects/94c20071890e4dc8a0dd4a5e6c844cb4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:26.142637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:26.145670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:26.230750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 842/1658] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:26.371185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:26.377069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:26.386537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01262f6f-fa55-4e56-b8bc-079b92103645 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:26.408080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:26.409177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:26.409614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:26.410038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] PATH_INFO: `/v3/users/b48d336cfca94b09a22fc46656e9773c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:26.415906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48d336cfca94b09a22fc46656e9773c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:26.418686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:26.530033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4aae5-57c0-4233-a5a3-7e503449a816 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:26.577872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:26.582973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:26.584064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:26.585225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:26.622505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:26.629571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:26.647231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 843/1659] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:26.648229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:26.648761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48d336cfca94b09a22fc46656e9773c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.650624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48d336cfca94b09a22fc46656e9773c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.652649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48d336cfca94b09a22fc46656e9773c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.654841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:26.669486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800e88a-be3c-4dad-9a39-fd7117fba040 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:26.674927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:26.676071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:26.676531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:26.677095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] PATH_INFO: `/v3/projects/67015f6dc5314b809e00f9d78dbea0c6` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:26.700066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67015f6dc5314b809e00f9d78dbea0c6)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:26.708062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:26.749079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48d336cfca94b09a22fc46656e9773c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.766197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-8233e2dc-bafe-47b8-b862-08a5e7efd9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48d336cfca94b09a22fc46656e9773c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.801905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 817/1660] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:26 2021] DELETE /identity/v3/users/b48d336cfca94b09a22fc46656e9773c => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:26.810683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:26.810683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:26.810683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:26.839938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:26.841429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:26.927223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67015f6dc5314b809e00f9d78dbea0c6', 'request_id': 'req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.945279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67015f6dc5314b809e00f9d78dbea0c6', 'request_id': 'req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.962022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67015f6dc5314b809e00f9d78dbea0c6', 'request_id': 'req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:26.966047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 818/1661] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 14 22:25:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:27.040520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:27.040520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:27.052648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13a2c-e462-420a-8fc3-e96160cef133 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:27.071472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] The token cache is being invalidate because project 67015f6dc5314b809e00f9d78dbea0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:27.074171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:27.074171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-cc2e7cd5-df17-4ab1-ad08-c77e51bbf295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:27.079572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 844/1662] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:26 2021] DELETE /identity/v3/projects/67015f6dc5314b809e00f9d78dbea0c6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:27.081530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:27.081856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:27.082200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:27.129367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:27.132130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:27.194000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:27.195031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:27.195832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:27.196709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:27.201883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:27.215392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:27.217554 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30781-5944-4d9b-b7c8-c1623eeff776 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:27.257373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 819/1663] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:27 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:27.292829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 845/1664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:27.293047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:27.293271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:27.293588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:27.328658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:27.330481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:27.350618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:27.360297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 820/1665] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:27.365913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bc0fc-2923-4533-8512-40aa94a37992 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:27.372860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:27.381801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:27.381801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:27.381801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:27.381801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:27.381801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:27.383337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:27.419704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:27.431510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 846/1666] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:27.433933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c25fd3-c374-4457-b3f6-8a9e5058c921 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:27.440587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16270071-5250-4cc3-a25b-b25f5c4ce555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:27.442621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16270071-5250-4cc3-a25b-b25f5c4ce555 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:27.444042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16270071-5250-4cc3-a25b-b25f5c4ce555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:27.445213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16270071-5250-4cc3-a25b-b25f5c4ce555 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:27.446156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16270071-5250-4cc3-a25b-b25f5c4ce555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:27.451923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16270071-5250-4cc3-a25b-b25f5c4ce555 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:27.553328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:27.563330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 821/1667] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:27 2021] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:27.567351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cc322-dd07-44c3-ab96-26eb3c8d0dc1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:27.727663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:27.730906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:27.731339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:27.731972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:27.733553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:27.744103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:28.486757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb5be-efec-48be-b3fd-188ecfca809d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:28.487297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb5be-efec-48be-b3fd-188ecfca809d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:28.487377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb5be-efec-48be-b3fd-188ecfca809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:28.517499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4cdeb5be-efec-48be-b3fd-188ecfca809d None None] MFA Rules not processed for user `2b716212224140038d211a75a5ee709f`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:28.518724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4cdeb5be-efec-48be-b3fd-188ecfca809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:28.599447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 822/1668] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:28.603546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:28.604016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:28.604988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:28.624126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] MFA Rules not processed for user `2b716212224140038d211a75a5ee709f`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:28.625384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:28.632583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 823/1669] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:28.645136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:28.647023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:28.724118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3f359-63a1-4f87-9977-f0f4ce79e1a4 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:28.731687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:28.732362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:28.732677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:28.732950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:28.741486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:28.743086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:28.755254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 824/1670] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:28 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:29.011677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 847/1671] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:27 2021] POST /identity/v3/users => generated 292 bytes in 1454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:29.012458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:29.039465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e87b-97f6-4541-bdd6-bfa0b712fed5 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:29.052737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:29.053430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:29.053713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:29.053994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:29.054729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:29.056546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:29.094171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 825/1672] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:29.098355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:29.115288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7bfd2-5444-43b9-bd0c-4a641ccefc68 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:29.123119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99724a-22f8-4862-a6dc-514cc07972a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:29.124095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99724a-22f8-4862-a6dc-514cc07972a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:29.124621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99724a-22f8-4862-a6dc-514cc07972a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:29.125097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99724a-22f8-4862-a6dc-514cc07972a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:29.126044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99724a-22f8-4862-a6dc-514cc07972a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:29.129524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99724a-22f8-4862-a6dc-514cc07972a6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:29.157744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:29.165360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 848/1673] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:29 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:29.170173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e362c0-e9e5-4e05-be23-10b5aa0357b0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:29.181034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:29.185767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:29.185767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:29.185767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] PATH_INFO: `/v3/projects/324702c7000d42ee8230d1d4132a5560/users/bbf817768b6c4f30a0ef3f765930965b/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:29.240586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324702c7000d42ee8230d1d4132a5560, user_id=bbf817768b6c4f30a0ef3f765930965b, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:29.254023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:29.366704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 826/1674] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:29 2021] PUT /identity/v3/projects/324702c7000d42ee8230d1d4132a5560/users/bbf817768b6c4f30a0ef3f765930965b/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:29.422498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:29.423663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:29.423971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:29.509845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] MFA Rules not processed for user `bbf817768b6c4f30a0ef3f765930965b`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:29.511604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:29.663751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 849/1675] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:29 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:29.671366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:29.816866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3a16-5470-43ea-a865-aa551c7f9dd0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:29.844052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:29.845993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:29.847508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:29.848017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:29.849975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:29.857463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:30.132154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 827/1676] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:29 2021] POST /identity/v3/projects => generated 381 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:30.136122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:30.168901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227edd9-276f-435d-924f-e083c16e1071 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:30.228094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:30.230755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:30.467860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:30.472120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:30.604341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:30.604341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:30.604341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:30.604341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:30.605608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844bc43-cc9c-4741-b5e5-ce0d81536ec5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:30.605608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:30.605608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:30.605608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:30.606024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] PATH_INFO: `/v3/projects/4c5244ebdd8f46deb2fd98e6d5517fe1` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:30.606024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5244ebdd8f46deb2fd98e6d5517fe1)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:30.606024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:30.795113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 850/1677] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:30 2021] POST /identity/v3/users => generated 297 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:30.809710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:30.861670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5244ebdd8f46deb2fd98e6d5517fe1', 'request_id': 'req-bfd042e7-6285-4490-ba1d-8962236a11a1'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:30.871996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5244ebdd8f46deb2fd98e6d5517fe1', 'request_id': 'req-bfd042e7-6285-4490-ba1d-8962236a11a1'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:30.878297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb0c6c-388e-478e-9009-14310c1a515e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:30.882845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5244ebdd8f46deb2fd98e6d5517fe1', 'request_id': 'req-bfd042e7-6285-4490-ba1d-8962236a11a1'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.000814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] The token cache is being invalidate because project 4c5244ebdd8f46deb2fd98e6d5517fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:31.001116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.003916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bfd042e7-6285-4490-ba1d-8962236a11a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.015463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 828/1678] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:30 2021] DELETE /identity/v3/projects/4c5244ebdd8f46deb2fd98e6d5517fe1 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:31.021706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957f23-42d9-474f-be05-a35debcf83be None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:31.022083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957f23-42d9-474f-be05-a35debcf83be None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:31.026863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957f23-42d9-474f-be05-a35debcf83be None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:31.034063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 829/1679] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:25:31 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:31.036708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957f23-42d9-474f-be05-a35debcf83be None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:31.043677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d1957f23-42d9-474f-be05-a35debcf83be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:31.281655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbdbfc-1906-44e9-85ee-32dd8a0c3eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:31.281655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbdbfc-1906-44e9-85ee-32dd8a0c3eae admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:31.281655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbdbfc-1906-44e9-85ee-32dd8a0c3eae admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:31.281655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbdbfc-1906-44e9-85ee-32dd8a0c3eae admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:31.282414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbdbfc-1906-44e9-85ee-32dd8a0c3eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:31.282414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbdbfc-1906-44e9-85ee-32dd8a0c3eae admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:31.282414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 851/1680] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:30 2021] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:31.282414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d547-5475-40c5-adfc-e4ed8e503b48 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:31.282414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d547-5475-40c5-adfc-e4ed8e503b48 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:31.282414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d547-5475-40c5-adfc-e4ed8e503b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:31.283076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957f23-42d9-474f-be05-a35debcf83be None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:31.283076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:31.283076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:31.283076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:31.283695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] PATH_INFO: `/v3/users/7653c037425e44b2a8321234692b1a1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:31.283695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7653c037425e44b2a8321234692b1a1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:31.283695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:31.284292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e4c2d547-5475-40c5-adfc-e4ed8e503b48 None None] MFA Rules not processed for user `2b716212224140038d211a75a5ee709f`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:31.284292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e4c2d547-5475-40c5-adfc-e4ed8e503b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:31.393347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 852/1681] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:31.394799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb634-97bf-4b0a-afa4-6c09b16da280 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:31.395125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb634-97bf-4b0a-afa4-6c09b16da280 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:31.395441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb634-97bf-4b0a-afa4-6c09b16da280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:31.488399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-73afb634-97bf-4b0a-afa4-6c09b16da280 None None] MFA Rules not processed for user `55444e3006684638a8d1c329eaba625f`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:31.489870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-73afb634-97bf-4b0a-afa4-6c09b16da280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:31.609015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7653c037425e44b2a8321234692b1a1b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.615416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7653c037425e44b2a8321234692b1a1b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.617622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7653c037425e44b2a8321234692b1a1b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.753214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 853/1682] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:31 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:31.755750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:31.756053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:31.756344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:31.810909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:31.810909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:31.872202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7653c037425e44b2a8321234692b1a1b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.897977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7653c037425e44b2a8321234692b1a1b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:31.970212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 830/1683] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:31 2021] DELETE /identity/v3/users/7653c037425e44b2a8321234692b1a1b => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:31.979107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:31.984303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:32.085525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 854/1684] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:25:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:32.086383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:32.087822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:32.118657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a308b-b8bb-46ab-b6fc-09ecad30ba93 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:32.219548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be417c-02d5-4e33-b540-7279a92b4f72 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:32.219548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:32.219548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:32.219548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:32.221985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] PATH_INFO: `/v3/projects/60b9c4e5d05a4ac689e1d6748a5f6b21/users/5d2b767a2edf447dbd0c02d250b2d679/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:32.254120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b9c4e5d05a4ac689e1d6748a5f6b21, user_id=5d2b767a2edf447dbd0c02d250b2d679, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:32.259555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:32.266702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:32.267844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:32.268361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:32.269054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] PATH_INFO: `/v3/projects/0b6c005d58dc4878a7ad752af07435b7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:32.272061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6c005d58dc4878a7ad752af07435b7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:32.274326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:32.411554 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 831/1685] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:31 2021] PUT /identity/v3/projects/60b9c4e5d05a4ac689e1d6748a5f6b21/users/5d2b767a2edf447dbd0c02d250b2d679/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:32.416588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:32.422711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:32.440964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6c005d58dc4878a7ad752af07435b7', 'request_id': 'req-a5907565-44fe-45e1-9061-a729c0bafcd6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:32.460814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6c005d58dc4878a7ad752af07435b7', 'request_id': 'req-a5907565-44fe-45e1-9061-a729c0bafcd6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:32.486451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6c005d58dc4878a7ad752af07435b7', 'request_id': 'req-a5907565-44fe-45e1-9061-a729c0bafcd6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:32.560559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] The token cache is being invalidate because project 0b6c005d58dc4878a7ad752af07435b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:32.560988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:32.561932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:32.563761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 855/1686] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:32 2021] DELETE /identity/v3/projects/0b6c005d58dc4878a7ad752af07435b7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:32.565902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:32.580411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:32.696022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0245f20-8cab-4d35-92cf-09a6611fb97f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:32.822178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5907565-44fe-45e1-9061-a729c0bafcd6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:32.839433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceff2f-7c6b-443f-a701-5425acceea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:32.840829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceff2f-7c6b-443f-a701-5425acceea60 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:32.842238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceff2f-7c6b-443f-a701-5425acceea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:32.843575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceff2f-7c6b-443f-a701-5425acceea60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:32.846396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceff2f-7c6b-443f-a701-5425acceea60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:32.851841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceff2f-7c6b-443f-a701-5425acceea60 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:32.870896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:32.872062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:32.875656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:32.883450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:32.883450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:32.889574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 856/1687] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:32 2021] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:32.889574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:32.889574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:32.890895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:32.964700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:32.967573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:32.996954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 857/1688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:33.001729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:33.058243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e829d-4982-4b10-95b9-1724d519a605 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:33.078259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be7f1f-db77-4115-9085-efbc8ae1742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:33.079187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be7f1f-db77-4115-9085-efbc8ae1742a admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.079479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be7f1f-db77-4115-9085-efbc8ae1742a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.079824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be7f1f-db77-4115-9085-efbc8ae1742a admin admin] PATH_INFO: `/v3/projects/60b9c4e5d05a4ac689e1d6748a5f6b21/users/5d2b767a2edf447dbd0c02d250b2d679/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.084881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be7f1f-db77-4115-9085-efbc8ae1742a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b9c4e5d05a4ac689e1d6748a5f6b21, user_id=5d2b767a2edf447dbd0c02d250b2d679, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:33.087392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be7f1f-db77-4115-9085-efbc8ae1742a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:33.144609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 858/1689] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:32 2021] PUT /identity/v3/projects/60b9c4e5d05a4ac689e1d6748a5f6b21/users/5d2b767a2edf447dbd0c02d250b2d679/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:33.144808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:33.144896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b479-ec54-4cde-9379-b64c1dec23e9 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.144896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b479-ec54-4cde-9379-b64c1dec23e9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.144896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b479-ec54-4cde-9379-b64c1dec23e9 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.145109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ab15-99ba-48d2-94c6-31b71afde56b service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:33.145181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 859/1690] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:25:33 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:33.145956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c911-5595-42d6-9395-82a7529436e2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.146251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c911-5595-42d6-9395-82a7529436e2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.146532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c911-5595-42d6-9395-82a7529436e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.217393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c4c7c911-5595-42d6-9395-82a7529436e2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:33.218680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c4c7c911-5595-42d6-9395-82a7529436e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:33.220678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 832/1691] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:32 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:33.258716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.267282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.267282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.369868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 860/1692] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:33.369868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.369868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.369868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.374158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] MFA Rules not processed for user `5d2b767a2edf447dbd0c02d250b2d679`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:33.379126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:33.412950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:33.414177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:33.637909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 833/1693] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:33 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:33.642786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:33.677900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80346c-f070-44e7-b7b2-cd4b8420144a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:33.681155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 861/1694] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:25:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:33.682006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:33.683674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:33.692132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:33.692896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.697486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.697942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.698834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:33.699169 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:33.705246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:33.752856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 834/1695] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:33.755761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:33.789243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895eb5d3-8eb0-4083-bb0d-04bb36348fda admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:33.798789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa3c8b-1756-4d3f-886a-aab22f69b21d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:33.811083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:33.817854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:33.818546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.818868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.819111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.829041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:33.829410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:33.829630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:33.830415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:33.840889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:33.842344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:33.861135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:33.863452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 862/1696] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:33 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:34.169488 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:34.189974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1321a3-c673-49fa-bd5d-f2cb7b488f8e service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:34.196497 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 835/1697] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:33 2021] POST /identity/v3/projects => generated 365 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:34.197535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:34.350804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d575e9-b1d6-4e28-976b-d1bab32a2b6c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:34.368094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:34.372794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:34.373111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:34.373481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:34.374293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:34.377245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:34.441332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:34.441864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:34.442370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:34.442806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:34.449695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:34.504437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 836/1698] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:34 2021] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:34.511310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:34.515381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:34.573848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a5f8-fce1-4f78-8656-2b7cd5a43305 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:34.589842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:34.595026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:34.596291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:34.604008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] PATH_INFO: `/v3/projects/4a510e0aba3746a7a9432cf28913417d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:34.613801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a510e0aba3746a7a9432cf28913417d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:34.619445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:34.676993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:34.678983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:34.714168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 863/1699] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:34 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:34.720074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:34.720074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:34.834879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a510e0aba3746a7a9432cf28913417d', 'request_id': 'req-9d91c23f-88e4-43f1-82a5-366ab258be7a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:34.847239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a510e0aba3746a7a9432cf28913417d', 'request_id': 'req-9d91c23f-88e4-43f1-82a5-366ab258be7a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:34.857962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a510e0aba3746a7a9432cf28913417d', 'request_id': 'req-9d91c23f-88e4-43f1-82a5-366ab258be7a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:34.933663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4205b-3838-4e12-8466-da47cffc412e service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:35.040736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] The token cache is being invalidate because project 4a510e0aba3746a7a9432cf28913417d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:35.042282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:35.042614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:35.045485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 837/1700] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:34 2021] DELETE /identity/v3/projects/4a510e0aba3746a7a9432cf28913417d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:35.046820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:35.048001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:35.076407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:35.077577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.080225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.081008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.085673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:35.114499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:35.117102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d4c24-be1a-4bde-bbfc-abbc1ad57aaa service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:35.129756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 864/1701] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:35.131132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677a73-d3ae-4c5f-bccc-245e659441d8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.131430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677a73-d3ae-4c5f-bccc-245e659441d8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.131733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677a73-d3ae-4c5f-bccc-245e659441d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.197110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c23f-88e4-43f1-82a5-366ab258be7a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:35.210700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:35.211389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-27677a73-d3ae-4c5f-bccc-245e659441d8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:35.212778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.213253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-27677a73-d3ae-4c5f-bccc-245e659441d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:35.216815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.217500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.218900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:35.222265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:35.238229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 865/1702] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:35.255932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.256226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.264909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.271805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 838/1703] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:35 2021] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:35.278232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:35.302194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd760-0156-4639-9b2c-86bcf49869b1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:35.313959 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:35.318403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.318983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.319639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.320896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:35.326510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:35.360172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 839/1704] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:35 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:35.383388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:35.383388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:35.388565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 866/1705] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:35.388899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:35.393212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:35.411287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16f8b-eea8-4b77-8553-2d8be879f557 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:35.433262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:35.436784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.437419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455225ea-8f0b-46c6-8aa1-981157dbaf3b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:35.437929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.438740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.441975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:35.442516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:35.571185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:35.571581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:35.571581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.571581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.571581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] PATH_INFO: `/v3/projects/4b9ccb6b22bd4150bbdc7b0bd4e206b9/users/2f7651cef92742fca095c82783f4c85e/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.571937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 867/1706] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:35.571937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:35.571937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353dde-7863-4e6a-a812-2c341ce0e93d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:35.571937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b7e66-fecc-47e2-8aa8-fdd9ac6e2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:35.572253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7e66-fecc-47e2-8aa8-fdd9ac6e2f09 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:35.572253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7e66-fecc-47e2-8aa8-fdd9ac6e2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:35.572253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7e66-fecc-47e2-8aa8-fdd9ac6e2f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:35.572253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7e66-fecc-47e2-8aa8-fdd9ac6e2f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:35.572253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7e66-fecc-47e2-8aa8-fdd9ac6e2f09 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:35.572706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9ccb6b22bd4150bbdc7b0bd4e206b9, user_id=2f7651cef92742fca095c82783f4c85e, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:35.572706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:36.139716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 840/1707] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:35 2021] PUT /identity/v3/projects/4b9ccb6b22bd4150bbdc7b0bd4e206b9/users/2f7651cef92742fca095c82783f4c85e/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:36.139716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:36.142133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 868/1708] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:35 2021] POST /identity/v3/projects => generated 401 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:36.147247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:36.148032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:36.148335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:36.148655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:36.222154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] MFA Rules not processed for user `2f7651cef92742fca095c82783f4c85e`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:36.223562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:36.344181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a26f2-3588-43e9-80dd-03a3cf57efdc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:36.432613 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 869/1709] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:36 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:36.433986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:36.540540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:36.540696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:36.541017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:36.561195 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:36.569149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:36.590379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:36.591636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:36.604263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 841/1710] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:36.605162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:36.611106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdb694-0192-4541-b209-3051ae7d70d4 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:36.640291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:36.641420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:36.641920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:36.642473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:36.643963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b575d9-d128-4b27-a6a2-7a271717120e service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:36.645352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:36.650628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:36.650834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:36.651506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:36.651884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:36.652068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:36.652853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:36.654848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:36.877432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 870/1711] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:36 2021] POST /identity/v3/users => generated 301 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:36.880934 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:36.910011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a2a2-54f6-4777-a820-8872ad82c697 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:36.915205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:36.915977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:36.916332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:36.917265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:36.918091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:36.920012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:36.947561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 871/1712] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:36 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:36.952546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:36.975216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42613d17-0f62-4195-8d49-59da5638fac1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:36.985156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:36.986082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:36.986461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:36.986740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:36.987555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:36.996880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:37.021101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 872/1713] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:36 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:37.025003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:37.036031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33215d6e-9908-45c7-96d4-f151f8f865a4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:37.042394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603f48-8cc8-40cf-89a8-60b468b87064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:37.047681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603f48-8cc8-40cf-89a8-60b468b87064 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.047681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603f48-8cc8-40cf-89a8-60b468b87064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.047681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603f48-8cc8-40cf-89a8-60b468b87064 admin admin] PATH_INFO: `/v3/projects/eb6495ade58e4982aa32ec7b4c7343a9/users/9fae890a12ef43cb955ddd8cd44d4daf/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.076266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 842/1714] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:36 2021] POST /identity/v3/projects => generated 365 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:37.080434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:37.081811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603f48-8cc8-40cf-89a8-60b468b87064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6495ade58e4982aa32ec7b4c7343a9, user_id=9fae890a12ef43cb955ddd8cd44d4daf, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:37.089021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603f48-8cc8-40cf-89a8-60b468b87064 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:37.205380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2be21-1812-4d02-8b72-4f186c1aa78e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:37.216761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 873/1715] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:37 2021] PUT /identity/v3/projects/eb6495ade58e4982aa32ec7b4c7343a9/users/9fae890a12ef43cb955ddd8cd44d4daf/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:37.231970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae8df4-336a-44f7-a3f9-4215dc50b98e None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.232368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae8df4-336a-44f7-a3f9-4215dc50b98e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.238517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae8df4-336a-44f7-a3f9-4215dc50b98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.345452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-82ae8df4-336a-44f7-a3f9-4215dc50b98e None None] MFA Rules not processed for user `9fae890a12ef43cb955ddd8cd44d4daf`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:37.349569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-82ae8df4-336a-44f7-a3f9-4215dc50b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:37.382847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:37.385112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.385690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.387312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.390089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:37.394741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:37.531617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 874/1716] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:37 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:37.536205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.536533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.536841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.565123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] MFA Rules not processed for user `d8252f18c467437699c3fb15f28ff9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:37.566956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:37.705369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 843/1717] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:37 2021] POST /identity/v3/users => generated 289 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:37.705369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:37.710021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 875/1718] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:37 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:37.712342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:37.752373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514c6e4-7724-41fa-8438-60089491a755 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:37.757908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305e8d8-53ac-4403-897a-8e818170b18c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:37.763455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:37.764643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.765172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.766473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.767180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:37.769448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:37.776665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:37.777963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.777963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.778248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.779024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:37.789396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 876/1719] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:37 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:37.790609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:37.806243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b22c50-63cb-452f-b3f8-d664bf24a680 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:37.814434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:37.814911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:37.815674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:37.816804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:37.817271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] PATH_INFO: `/v3/projects/44b5aa88253d4296849ecdd21d6e1f6f/users/0925228e2e694870a6ae53959f14549c/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:37.843699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b5aa88253d4296849ecdd21d6e1f6f, user_id=0925228e2e694870a6ae53959f14549c, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:37.851463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.085801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 877/1720] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:37 2021] PUT /identity/v3/projects/44b5aa88253d4296849ecdd21d6e1f6f/users/0925228e2e694870a6ae53959f14549c/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:38.090552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:38.179955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa6bc7-d747-4fc9-bad1-3bcadef7d50b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:38.186744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:38.188196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.188831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.189323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.191324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:38.193329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.212183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 878/1721] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:38 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:38.220148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:38.240966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020622e7-1dbb-44ba-9db0-bcb90462687b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:38.248083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e9fd-bb71-4d26-8d8f-3a915891a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:38.249077 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e9fd-bb71-4d26-8d8f-3a915891a7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.249659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e9fd-bb71-4d26-8d8f-3a915891a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.250310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e9fd-bb71-4d26-8d8f-3a915891a7cd admin admin] PATH_INFO: `/v3/projects/44b5aa88253d4296849ecdd21d6e1f6f/users/0925228e2e694870a6ae53959f14549c/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.252983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036e9fd-bb71-4d26-8d8f-3a915891a7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b5aa88253d4296849ecdd21d6e1f6f, user_id=0925228e2e694870a6ae53959f14549c, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:38.262846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036e9fd-bb71-4d26-8d8f-3a915891a7cd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.292886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 879/1722] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:38 2021] PUT /identity/v3/projects/44b5aa88253d4296849ecdd21d6e1f6f/users/0925228e2e694870a6ae53959f14549c/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:38.294868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.295234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.295521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.317652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 844/1723] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:37 2021] POST /identity/v3/projects => generated 399 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:38.321546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:38.343385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] MFA Rules not processed for user `0925228e2e694870a6ae53959f14549c`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:38.345039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:38.430591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 880/1724] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:38 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:38.441795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:38.445019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:38.476343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742b302-210e-44fd-9f57-925b11749936 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:38.481823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:38.486501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.486501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.486501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.486501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:38.486501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.509455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab8ec2-c706-47a1-8b4e-b3906ce2e2c0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:38.519229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:38.520195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.521146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.521442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.545691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:38.545691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.560948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 881/1725] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:38 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:38.645821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 845/1726] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:38 2021] POST /identity/v3/users => generated 306 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:38.646584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:38.660196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131df78-7e28-4f53-a8af-c577560923e5 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:38.669842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:38.670520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.670808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.671086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.671818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:38.673487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.686391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 882/1727] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:38.691580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:38.724835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413ae81-4079-4acf-9137-c2c6285afcc0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:38.734878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:38.735964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:38.736735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:38.747855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] PATH_INFO: `/v3/projects/ea4b31cbeb6746e494a787ab619901ac/users/43c2d56088b949f6bd52573f62143ff3/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:38.782967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4b31cbeb6746e494a787ab619901ac, user_id=43c2d56088b949f6bd52573f62143ff3, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:38.787327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:38.992279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 846/1728] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:38 2021] PUT /identity/v3/projects/ea4b31cbeb6746e494a787ab619901ac/users/43c2d56088b949f6bd52573f62143ff3/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:38.992364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.006322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a0f03-b016-44cc-8726-dab7b8a4f4b4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:39.137341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:39.138159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.138518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.138717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.139457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:39.141103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:39.163051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 883/1729] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:38 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:39.168745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.181034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.186929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897866bc-8e5a-44f8-bfb6-fc662d95a4f1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:39.194633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820467-c9e3-4ea6-8ad3-d392d11d890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:39.198621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820467-c9e3-4ea6-8ad3-d392d11d890d admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.199110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820467-c9e3-4ea6-8ad3-d392d11d890d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.199592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820467-c9e3-4ea6-8ad3-d392d11d890d admin admin] PATH_INFO: `/v3/projects/ea4b31cbeb6746e494a787ab619901ac/users/43c2d56088b949f6bd52573f62143ff3/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.200108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d174f7-6c6b-46e5-9e09-fc18cb35ba4a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:39.203470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d820467-c9e3-4ea6-8ad3-d392d11d890d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4b31cbeb6746e494a787ab619901ac, user_id=43c2d56088b949f6bd52573f62143ff3, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:39.205119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:39.205996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.206285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.206568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] PATH_INFO: `/v3/users/2f7651cef92742fca095c82783f4c85e` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.207425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d820467-c9e3-4ea6-8ad3-d392d11d890d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:39.207783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7651cef92742fca095c82783f4c85e)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:39.209760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:39.233515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 847/1730] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:39 2021] PUT /identity/v3/projects/ea4b31cbeb6746e494a787ab619901ac/users/43c2d56088b949f6bd52573f62143ff3/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:39.235221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.235557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.235924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.264436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] MFA Rules not processed for user `43c2d56088b949f6bd52573f62143ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:39.268746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:39.340528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 848/1731] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:39 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:39.350243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.351634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:39.408052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceedf2-748a-4884-b709-e9633ec1b6ba None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:39.411661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f120ba9-1218-4d77-beeb-c1fea268bf27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:39.412309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f120ba9-1218-4d77-beeb-c1fea268bf27 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.412668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f120ba9-1218-4d77-beeb-c1fea268bf27 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.412941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f120ba9-1218-4d77-beeb-c1fea268bf27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.422999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f120ba9-1218-4d77-beeb-c1fea268bf27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:39.424471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f120ba9-1218-4d77-beeb-c1fea268bf27 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:39.434182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 849/1732] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:39 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:39.494117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7651cef92742fca095c82783f4c85e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:39.621846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7651cef92742fca095c82783f4c85e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:39.640065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7651cef92742fca095c82783f4c85e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:39.648753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7651cef92742fca095c82783f4c85e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:39.649648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7651cef92742fca095c82783f4c85e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:39.662814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 884/1733] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:39 2021] DELETE /identity/v3/users/2f7651cef92742fca095c82783f4c85e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:39.664347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.665050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.665050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.695179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:39.696629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:39.715010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.717009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:39.778931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 850/1734] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:39.778931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.778931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:39.850413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d5ec-4d03-4314-bd14-1cc9fa64c294 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:39.854547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:39.855767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.856206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.856727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.858932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:39.872998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1b28-2205-4dd3-9101-b62cc93ff70b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:39.878503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:39.879625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:39.880044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:39.880502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] PATH_INFO: `/v3/users/bbf817768b6c4f30a0ef3f765930965b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:39.881933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf817768b6c4f30a0ef3f765930965b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:39.884067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:39.943730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:39.959451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:39.983288 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 851/1735] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:39 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:39.984750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:39.986308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:40.092378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e01bb-ac0a-4d28-96b4-65c57bae03c0 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:40.097418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55099a75-e6cd-4a4c-8e4e-9150cc025916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:40.098441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55099a75-e6cd-4a4c-8e4e-9150cc025916 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:40.098735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55099a75-e6cd-4a4c-8e4e-9150cc025916 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:40.099017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55099a75-e6cd-4a4c-8e4e-9150cc025916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:40.111280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55099a75-e6cd-4a4c-8e4e-9150cc025916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:40.112929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55099a75-e6cd-4a4c-8e4e-9150cc025916 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:40.124860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 852/1736] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:40.151187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf817768b6c4f30a0ef3f765930965b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:40.249896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf817768b6c4f30a0ef3f765930965b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:40.275617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf817768b6c4f30a0ef3f765930965b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:40.286586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf817768b6c4f30a0ef3f765930965b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:40.288032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf817768b6c4f30a0ef3f765930965b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:40.295822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 885/1737] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:39 2021] DELETE /identity/v3/users/bbf817768b6c4f30a0ef3f765930965b => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:40.300559 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:40.301051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:40.301336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:40.319735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:40.321234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:40.408053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 853/1738] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:40.423499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:40.425018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:40.502490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686f09-e6f3-4cef-acb4-fbad737e7680 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:40.507740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d140-ec5f-42f7-8c42-fa4a4ec04d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:40.508630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d140-ec5f-42f7-8c42-fa4a4ec04d4b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:40.509009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d140-ec5f-42f7-8c42-fa4a4ec04d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:40.509509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d140-ec5f-42f7-8c42-fa4a4ec04d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:40.522364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632d140-ec5f-42f7-8c42-fa4a4ec04d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:40.523935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632d140-ec5f-42f7-8c42-fa4a4ec04d4b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:40.537036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 886/1739] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:41.136086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:41.137797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:41.158009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc2764-4257-46d7-869c-1613a237b43b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:41.176645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:41.177603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:41.178015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:41.178314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] PATH_INFO: `/v3/projects/4b9ccb6b22bd4150bbdc7b0bd4e206b9` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:41.179526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9ccb6b22bd4150bbdc7b0bd4e206b9)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:41.181658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:41.268688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:41.269223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:41.269900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:41.291095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] MFA Rules not processed for user `55444e3006684638a8d1c329eaba625f`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:41.292583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:41.348333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9ccb6b22bd4150bbdc7b0bd4e206b9', 'request_id': 'req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.354625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9ccb6b22bd4150bbdc7b0bd4e206b9', 'request_id': 'req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.362833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9ccb6b22bd4150bbdc7b0bd4e206b9', 'request_id': 'req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.369131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 887/1740] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:41 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:41.459295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] The token cache is being invalidate because project 4b9ccb6b22bd4150bbdc7b0bd4e206b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:41.459641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.460261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.461842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 854/1741] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:41 2021] DELETE /identity/v3/projects/4b9ccb6b22bd4150bbdc7b0bd4e206b9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:41.466283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:41.478904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e0b4-d05a-4dd2-9ea5-4fb875f4504b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:41.557656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:41.559366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:41.559798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:41.560220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] PATH_INFO: `/v3/users/0925228e2e694870a6ae53959f14549c` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:41.562710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0925228e2e694870a6ae53959f14549c)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:41.565029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:41.835678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0925228e2e694870a6ae53959f14549c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.918962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:41.919537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0925228e2e694870a6ae53959f14549c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.920498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:41.933698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0925228e2e694870a6ae53959f14549c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.942337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c9217-14ef-4e5c-a3cb-46bbbe3b40db admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:41.949975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:41.951132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:41.951568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:41.952152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] PATH_INFO: `/v3/projects/324702c7000d42ee8230d1d4132a5560` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:41.962441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324702c7000d42ee8230d1d4132a5560)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:41.962441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:41.971878 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0925228e2e694870a6ae53959f14549c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:41.983484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0925228e2e694870a6ae53959f14549c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.009726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 888/1742] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:41 2021] DELETE /identity/v3/users/0925228e2e694870a6ae53959f14549c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:42.093795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324702c7000d42ee8230d1d4132a5560', 'request_id': 'req-cc556865-f0f4-409d-9361-ec5aa3cff4f7'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.101630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324702c7000d42ee8230d1d4132a5560', 'request_id': 'req-cc556865-f0f4-409d-9361-ec5aa3cff4f7'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.111411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324702c7000d42ee8230d1d4132a5560', 'request_id': 'req-cc556865-f0f4-409d-9361-ec5aa3cff4f7'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.197777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] The token cache is being invalidate because project 324702c7000d42ee8230d1d4132a5560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:42.200312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.201048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.205102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 855/1743] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:41 2021] DELETE /identity/v3/projects/324702c7000d42ee8230d1d4132a5560 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:42.207346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:42.211250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:42.312250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5c83-5fe5-4df2-b677-0f411c406c04 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:42.385433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:42.386037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:42.386329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:42.386608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] PATH_INFO: `/v3/users/5d2b767a2edf447dbd0c02d250b2d679` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:42.387832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2b767a2edf447dbd0c02d250b2d679)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:42.389795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:42.735203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2b767a2edf447dbd0c02d250b2d679'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.829112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2b767a2edf447dbd0c02d250b2d679'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.830214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:42.832472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:42.845949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2b767a2edf447dbd0c02d250b2d679'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.853851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2b767a2edf447dbd0c02d250b2d679'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.854639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-867f3fba-f23b-4af7-83cb-170c76932b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2b767a2edf447dbd0c02d250b2d679'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:42.867564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc556865-f0f4-409d-9361-ec5aa3cff4f7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:42.872565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 889/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:42 2021] DELETE /identity/v3/users/5d2b767a2edf447dbd0c02d250b2d679 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:42.880291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:42.881207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:42.886362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:42.886362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] PATH_INFO: `/v3/projects/44b5aa88253d4296849ecdd21d6e1f6f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:42.888033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b5aa88253d4296849ecdd21d6e1f6f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:42.892362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:43.065108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b5aa88253d4296849ecdd21d6e1f6f', 'request_id': 'req-b2d37926-8c19-4345-8a59-3847dd69a7cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.073806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b5aa88253d4296849ecdd21d6e1f6f', 'request_id': 'req-b2d37926-8c19-4345-8a59-3847dd69a7cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.081343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b5aa88253d4296849ecdd21d6e1f6f', 'request_id': 'req-b2d37926-8c19-4345-8a59-3847dd69a7cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.185174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] The token cache is being invalidate because project 44b5aa88253d4296849ecdd21d6e1f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:43.185174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.193055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b2d37926-8c19-4345-8a59-3847dd69a7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.193055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 856/1745] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:42 2021] DELETE /identity/v3/projects/44b5aa88253d4296849ecdd21d6e1f6f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:43.199996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.200300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.200611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.255926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:43.257269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:43.365702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 890/1746] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:43.378555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.379416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.379918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.409708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:43.411701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:43.430422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 857/1747] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:43.433168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:43.448350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a888e-68aa-4e9e-86c9-34549ef54a17 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:43.457187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:43.457952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.458249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.458531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.459275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:43.460849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:43.464293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:43.480820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 891/1748] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:43.487133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:43.500161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccc23d-5295-4333-9637-e2c03a3173e8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:43.505483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:43.506149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.506433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.506876 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.508085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:43.511207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:43.589134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:43.591929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:43.620821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071b81-edc1-4d22-8f8b-95a79bb6c91f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:43.624278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:43.625360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.625718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.626066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] PATH_INFO: `/v3/projects/60b9c4e5d05a4ac689e1d6748a5f6b21` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.627351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b9c4e5d05a4ac689e1d6748a5f6b21)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:43.629541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:43.645849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 858/1749] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:43 2021] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:43.649998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:43.725110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110ff9-5f96-4aa3-9adc-7c088144c31d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:43.730647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:43.731320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.731602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.731878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.733267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:43.735169 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:43.767154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b9c4e5d05a4ac689e1d6748a5f6b21', 'request_id': 'req-8926f133-ee87-4d7e-a846-2994896ab2e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.773696 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b9c4e5d05a4ac689e1d6748a5f6b21', 'request_id': 'req-8926f133-ee87-4d7e-a846-2994896ab2e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.780202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b9c4e5d05a4ac689e1d6748a5f6b21', 'request_id': 'req-8926f133-ee87-4d7e-a846-2994896ab2e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.907244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 859/1750] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:43 2021] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:43.908368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:43.920271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bb328-d026-4a01-8397-9b47755b0dad admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:43.934916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] The token cache is being invalidate because project 60b9c4e5d05a4ac689e1d6748a5f6b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:43.935255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.935874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8926f133-ee87-4d7e-a846-2994896ab2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:43.937824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 892/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:43 2021] DELETE /identity/v3/projects/60b9c4e5d05a4ac689e1d6748a5f6b21 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:43.943121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955c69a-b794-4a96-9884-c2e030c1c6a6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:43.943413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955c69a-b794-4a96-9884-c2e030c1c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:43.943698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955c69a-b794-4a96-9884-c2e030c1c6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:43.998487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f955c69a-b794-4a96-9884-c2e030c1c6a6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:44.001359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f955c69a-b794-4a96-9884-c2e030c1c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:44.088506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.089458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.089890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.090314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.091233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.093946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.112320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 860/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:43 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:44.117256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.124708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:44.148014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077442a6-35b4-436c-bfaf-f42c664e6027 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.163539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.164883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.165436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.165862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.167802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.170418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.181662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 893/1753] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:44.183168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.183462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.183744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.206643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 861/1754] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:44.206739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:44.209486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:44.209842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.227324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 894/1755] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:44.228315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa80b7-ddc1-4d65-9dab-210991bf69e9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.236877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.251524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeb1cc-2346-4bb4-920c-419a40a4a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.253247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeb1cc-2346-4bb4-920c-419a40a4a24f admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.253746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeb1cc-2346-4bb4-920c-419a40a4a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.254283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeb1cc-2346-4bb4-920c-419a40a4a24f admin admin] PATH_INFO: `/v3/projects/7164a55e727b4c24b1309afd1c041b78/users/3af11637c4674894bd833d4992391773/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.257605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d765f-50f8-4f10-92a0-7cf3fe54ac1a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.266471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.267408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.267408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.275102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.275102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:44.275102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.275102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.290065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeb1cc-2346-4bb4-920c-419a40a4a24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7164a55e727b4c24b1309afd1c041b78, user_id=3af11637c4674894bd833d4992391773, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.290268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 895/1756] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:44.291986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.294463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeb1cc-2346-4bb4-920c-419a40a4a24f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.304744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82600473-30fa-4bcb-a982-85c41aa9bb37 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.310397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.311081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.311364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.315143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.315143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.315143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.413672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 862/1757] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:44 2021] PUT /identity/v3/projects/7164a55e727b4c24b1309afd1c041b78/users/3af11637c4674894bd833d4992391773/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:44.425833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.426132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.426417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.472276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 896/1758] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:44.476455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.477266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] MFA Rules not processed for user `3af11637c4674894bd833d4992391773`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:44.478472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:44.546667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a8a00-b009-439d-9662-ce42544a18da admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.552272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.553209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.553503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.553786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.554487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.559669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.561990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 863/1759] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:44.562996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.575361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fd426-cf86-451c-b7b3-f701fc04f627 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.580078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.580795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.581086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.581366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.582068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.584075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.657307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 897/1760] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:44.658658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.669319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172af57-023b-4eec-9431-6954912519d6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.674532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.675331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.675688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.676037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.676886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.678584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.689911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 898/1761] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:44.693828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.703793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b92f53-30a2-4fa1-b316-75a376270f66 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.708539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.709207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.709503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.709791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.710732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.712335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.719970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 864/1762] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:44.726458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 899/1763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:44.726598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.728207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:44.740393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86507c-f693-4de7-adcd-1748d4a9467e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.812566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55ed6-bd43-4b01-9df1-26472595ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.813655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55ed6-bd43-4b01-9df1-26472595ec51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.813981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55ed6-bd43-4b01-9df1-26472595ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.814231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55ed6-bd43-4b01-9df1-26472595ec51 admin admin] PATH_INFO: `/v3/projects/60ee321da43a4d0c9dfac0ed66794562/users/3c612d3eeca147e7b70a6121bb034681/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.839776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b4da-c4dd-4d75-bbf7-014bd76af1c7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:44.841724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55ed6-bd43-4b01-9df1-26472595ec51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ee321da43a4d0c9dfac0ed66794562, user_id=3c612d3eeca147e7b70a6121bb034681, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.844607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55ed6-bd43-4b01-9df1-26472595ec51 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.845211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:44.846715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.847228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.847519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.849076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:44.851212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:44.920936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 900/1764] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:44 2021] PUT /identity/v3/projects/60ee321da43a4d0c9dfac0ed66794562/users/3c612d3eeca147e7b70a6121bb034681/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:44.926764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:44.927225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:44.927478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:44.952712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:44.954150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:44.997972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 865/1765] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:45.002347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.019770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8cb61-d06a-46b3-9434-6b99895f4afd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.048849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 901/1766] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:45.060714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.062199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:45.104034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.105942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.105942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.106225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.107052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.109054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.124485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 866/1767] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:45 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:45.127391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.140596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fe0e-a5e8-4001-9b55-0e33bd1290dd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.150703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.154795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.154795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.154795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.154795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.155636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.171901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e50e4-1b28-4be1-93be-49479fd26d8a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.175972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc3b6-a44d-46cb-bccc-1a2a41c14fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.176870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc3b6-a44d-46cb-bccc-1a2a41c14fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.177092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc3b6-a44d-46cb-bccc-1a2a41c14fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.177373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc3b6-a44d-46cb-bccc-1a2a41c14fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.183546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 867/1768] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:45 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:45.187792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.193529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc3b6-a44d-46cb-bccc-1a2a41c14fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.195287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc3b6-a44d-46cb-bccc-1a2a41c14fe3 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.201871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a126-aad5-418c-aa30-6507fa606cfb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.206902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.207898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.208916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.208916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] PATH_INFO: `/v3/projects/91b8867965624d8a924d01cf04727d40/users/c68cd2cb32ec476783b7105cadd2ba1d/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.215211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 902/1769] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:45.230813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b8867965624d8a924d01cf04727d40, user_id=c68cd2cb32ec476783b7105cadd2ba1d, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.235098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.321419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 868/1770] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:45 2021] PUT /identity/v3/projects/91b8867965624d8a924d01cf04727d40/users/c68cd2cb32ec476783b7105cadd2ba1d/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:45.331943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.332486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.332850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.361924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] MFA Rules not processed for user `c68cd2cb32ec476783b7105cadd2ba1d`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:45.363229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:45.446705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 903/1771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:45 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:45.456585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.542716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66828c9-a39f-4bf0-bf84-bf4aa52e141f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.548534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.549217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.549504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.549784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.550477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.552398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.679360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 869/1772] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:45 2021] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:45.683510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.700162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf3f6-bee6-48bc-8fbf-fbb30617f3c2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.773212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.774116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.774500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.774878 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.776912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.778524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.867383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 904/1773] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:45 2021] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:45.871430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.891987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ba1c-4197-49c1-9483-631b9296448c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.897871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.898557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.898866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.899152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.899890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.902230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.917703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 870/1774] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:45 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:45.918834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.919949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:45.921992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:45.930674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1ce5b-5863-4ee7-be0d-63be0a3e5021 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.936080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.937020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.937309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.937585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] PATH_INFO: `/v3/projects/4ce4853012ac4199ad14105a37b3213f/users/734873b9701b4e728d53544fd61fb115/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.937980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed3e3-6d52-4584-ad9d-b8703693c9b5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:45.946618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:45.956723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:45.956723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:45.956723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] PATH_INFO: `/v3/users/9fae890a12ef43cb955ddd8cd44d4daf` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:45.956723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fae890a12ef43cb955ddd8cd44d4daf)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.956723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:45.965088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce4853012ac4199ad14105a37b3213f, user_id=734873b9701b4e728d53544fd61fb115, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:45.970012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:46.058887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 905/1775] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:45 2021] PUT /identity/v3/projects/4ce4853012ac4199ad14105a37b3213f/users/734873b9701b4e728d53544fd61fb115/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:46.066063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:46.235871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fae890a12ef43cb955ddd8cd44d4daf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:46.237234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fae890a12ef43cb955ddd8cd44d4daf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:46.245071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fae890a12ef43cb955ddd8cd44d4daf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:46.262948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1abff-1094-4a61-afc2-4c69550ad6ce admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:46.276334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:46.277123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:46.277416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:46.277695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:46.279132 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:46.280749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:46.304968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 906/1776] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:46 2021] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:46.308089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:46.312955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:46.329896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a70a-7e32-418d-8309-8b4e9bf68634 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:46.334734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fae890a12ef43cb955ddd8cd44d4daf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:46.339448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e08b-ca71-4543-97c8-2d9b0975d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:46.341092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e08b-ca71-4543-97c8-2d9b0975d7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:46.341399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e08b-ca71-4543-97c8-2d9b0975d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:46.347991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e08b-ca71-4543-97c8-2d9b0975d7cb admin admin] PATH_INFO: `/v3/projects/4ce4853012ac4199ad14105a37b3213f/users/734873b9701b4e728d53544fd61fb115/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:46.349326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f9dfa55e-e142-4df1-a6f7-dddb0345d4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fae890a12ef43cb955ddd8cd44d4daf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:46.362530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 871/1777] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:45 2021] DELETE /identity/v3/users/9fae890a12ef43cb955ddd8cd44d4daf => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:46.367386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:46.367837 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:46.370574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e08b-ca71-4543-97c8-2d9b0975d7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce4853012ac4199ad14105a37b3213f, user_id=734873b9701b4e728d53544fd61fb115, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:46.371841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:46.373820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e08b-ca71-4543-97c8-2d9b0975d7cb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:46.394035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:46.399511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:46.399760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 907/1778] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:46 2021] PUT /identity/v3/projects/4ce4853012ac4199ad14105a37b3213f/users/734873b9701b4e728d53544fd61fb115/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:46.408388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:46.410655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:46.412906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:46.454129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] MFA Rules not processed for user `734873b9701b4e728d53544fd61fb115`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:46.456550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:46.465833 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 872/1779] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:46.480857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:46.482720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:46.565451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9dab8-bb81-4cfb-9178-afc6d46422df None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:46.571493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0f20c-0b41-4415-bed6-518883687579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:46.572633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f20c-0b41-4415-bed6-518883687579 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:46.573151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f20c-0b41-4415-bed6-518883687579 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:46.573628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f20c-0b41-4415-bed6-518883687579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:46.581519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 908/1780] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:46 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:46.592177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:46.594234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:46.597553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0f20c-0b41-4415-bed6-518883687579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:46.605832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0f20c-0b41-4415-bed6-518883687579 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:46.616168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 873/1781] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:46.685803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba942c-7f56-4e6f-8da6-2bb993506162 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:46.698482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2785cc-aa8f-44be-a9b6-360e5120491d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:46.699339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2785cc-aa8f-44be-a9b6-360e5120491d service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:46.699728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2785cc-aa8f-44be-a9b6-360e5120491d service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:46.700854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2785cc-aa8f-44be-a9b6-360e5120491d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:46.721771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2785cc-aa8f-44be-a9b6-360e5120491d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:46.723298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2785cc-aa8f-44be-a9b6-360e5120491d service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:46.738967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 909/1782] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:46 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:47.086643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.086935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.087220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.131000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f0bc7-b160-49d3-b060-38357b585fef None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.131555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f0bc7-b160-49d3-b060-38357b585fef None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.131555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f0bc7-b160-49d3-b060-38357b585fef None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.133670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 910/1783] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:25:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:25:47.142527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] MFA Rules not processed for user `3c612d3eeca147e7b70a6121bb034681`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:47.143846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.154985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.155275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.155552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.201641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:47.202980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.256541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 874/1784] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:47 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:47.261919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.266980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.288189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1202-f66a-4ea9-b270-32440a8c410a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.297572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.299068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.299472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.299822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.300816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.303503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:47.366964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 911/1785] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:25:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:47.368114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.369471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.384561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885164f6-ab91-4b8e-9b44-48819fd7adb6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.390865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.398757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.398757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.398757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] PATH_INFO: `/v3/projects/eb6495ade58e4982aa32ec7b4c7343a9` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.398757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6495ade58e4982aa32ec7b4c7343a9)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.398757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:47.435832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 875/1786] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:47 2021] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:47.437860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.551974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3138-a9d5-4484-aff3-9bf2f693d687 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.558110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.558861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.559406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.559406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.560102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.562138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:47.595072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6495ade58e4982aa32ec7b4c7343a9', 'request_id': 'req-88966823-45e0-48a5-a1bf-c5cb048af5df'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:47.606451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6495ade58e4982aa32ec7b4c7343a9', 'request_id': 'req-88966823-45e0-48a5-a1bf-c5cb048af5df'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:47.614421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6495ade58e4982aa32ec7b4c7343a9', 'request_id': 'req-88966823-45e0-48a5-a1bf-c5cb048af5df'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:47.734805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] The token cache is being invalidate because project eb6495ade58e4982aa32ec7b4c7343a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:47.735423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:47.735537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 876/1787] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:47 2021] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:47.736651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.738598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:47.739496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.743805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 912/1788] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:47 2021] DELETE /identity/v3/projects/eb6495ade58e4982aa32ec7b4c7343a9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:47.744906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.746578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.822171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966823-45e0-48a5-a1bf-c5cb048af5df admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.827056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.827736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.828031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.828305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.829098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.830713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:47.844546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 913/1789] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:47 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:47.844546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.844546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.853481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540981a2-04ab-4d82-9b80-8e1763cb1eef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.857766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e9648-d532-4687-82c5-c54ec1875350 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.862778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.863686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.864000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.864281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] PATH_INFO: `/v3/users/43c2d56088b949f6bd52573f62143ff3` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.865507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c2d56088b949f6bd52573f62143ff3)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.867592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:47.921884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.922646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.923001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.923346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.925275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:47.938545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.940315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:47.953532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 877/1790] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:47.954495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:47.965934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bf27-505a-4ad9-ac10-9ad59f479273 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:47.971055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:47.972082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:47.979015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:47.979015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] PATH_INFO: `/v3/projects/ba994235abfe43998d1b10d0b51497a1/users/b6422d8d98314b35ba0f199f0898f990/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:47.993224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba994235abfe43998d1b10d0b51497a1, user_id=b6422d8d98314b35ba0f199f0898f990, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:47.996680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:48.076486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 878/1791] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:47 2021] PUT /identity/v3/projects/ba994235abfe43998d1b10d0b51497a1/users/b6422d8d98314b35ba0f199f0898f990/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:48.079954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:48.154669 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c2d56088b949f6bd52573f62143ff3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:48.170470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04306057-f70b-447c-9536-1c2ca949cee3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:48.181062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:48.182539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:48.182955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:48.183335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:48.184293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:48.186610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:48.202434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 879/1792] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:48.206551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:48.222430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0631b-1868-446e-a38e-fc02bd28d836 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:48.229180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:48.230479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:48.230872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:48.231268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] PATH_INFO: `/v3/projects/ba994235abfe43998d1b10d0b51497a1/users/b6422d8d98314b35ba0f199f0898f990/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:48.233629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba994235abfe43998d1b10d0b51497a1, user_id=b6422d8d98314b35ba0f199f0898f990, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:48.236500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:48.250237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c2d56088b949f6bd52573f62143ff3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:48.258761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 880/1793] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:48 2021] PUT /identity/v3/projects/ba994235abfe43998d1b10d0b51497a1/users/b6422d8d98314b35ba0f199f0898f990/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:48.259957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:48.262095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:48.269775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c2d56088b949f6bd52573f62143ff3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:48.277771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c2d56088b949f6bd52573f62143ff3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:48.278521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c2d56088b949f6bd52573f62143ff3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:48.284984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 914/1794] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:47 2021] DELETE /identity/v3/users/43c2d56088b949f6bd52573f62143ff3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:48.335135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bdba4-0a46-42a4-b576-248dafcfed89 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:48.383248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:48.383913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:48.384202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:48.384522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:48.386378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:48.488343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:48.489846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdec0fe-ee74-4204-a1a0-c551f521e92a service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:48.512824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 881/1795] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:48 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:49.343093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:49.344957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:49.422705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c4cb-004a-42da-8832-178726235987 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:49.429040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:49.430591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:49.430969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:49.431203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] PATH_INFO: `/v3/projects/ea4b31cbeb6746e494a787ab619901ac` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:49.433135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4b31cbeb6746e494a787ab619901ac)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:49.435234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:49.694919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4b31cbeb6746e494a787ab619901ac', 'request_id': 'req-11ae8638-79e7-419b-8543-ac5699b37ed2'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:49.700270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4b31cbeb6746e494a787ab619901ac', 'request_id': 'req-11ae8638-79e7-419b-8543-ac5699b37ed2'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:49.706797 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4b31cbeb6746e494a787ab619901ac', 'request_id': 'req-11ae8638-79e7-419b-8543-ac5699b37ed2'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:49.793773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] The token cache is being invalidate because project ea4b31cbeb6746e494a787ab619901ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:49.794125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:49.794804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-11ae8638-79e7-419b-8543-ac5699b37ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:49.802438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 915/1796] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:49 2021] DELETE /identity/v3/projects/ea4b31cbeb6746e494a787ab619901ac => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:49.804891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:49.804891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:49.804891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:49.829234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:49.830670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:49.914743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 882/1797] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:49.917197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:49.917636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:49.917913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:49.938339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:49.940007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:49.948598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 916/1798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:49.953827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:49.964914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9427fd1-d5e2-47bd-bc5e-2834a3e26538 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:49.971263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:49.972231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:49.972558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:49.973362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:49.977074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:49.978232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:49.982458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:50.006923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 883/1799] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:25:50.008623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:50.026907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c103db-2843-44b5-bc5b-efcc2f59706f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:50.034095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bf34-e768-48dc-9963-2fd9eb2ef526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:50.036856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bf34-e768-48dc-9963-2fd9eb2ef526 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.036856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bf34-e768-48dc-9963-2fd9eb2ef526 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.036856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bf34-e768-48dc-9963-2fd9eb2ef526 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.037361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bf34-e768-48dc-9963-2fd9eb2ef526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:50.039642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bf34-e768-48dc-9963-2fd9eb2ef526 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:50.164383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 917/1800] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:50 2021] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:50.165646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:50.186505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fedf5-31fa-4494-add5-78b0ff7864e7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:50.281952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:50.283146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.283656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.284265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.285508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:50.287881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:50.441658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 884/1801] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:50 2021] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:50.445904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.446710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.447171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.449696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:50.478846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e4e5-4307-4592-83f7-8bc0995eec67 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:50.490513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:50.493774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.495313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.496902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.497867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:50.501278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:50.517032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] MFA Rules not processed for user `b6422d8d98314b35ba0f199f0898f990`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:50.519383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:50.540327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 885/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:50 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:50.542358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:50.564030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab26eab-36e5-46ae-944d-d3c5ac9ac941 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:50.570683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:50.573224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.573663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.574691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.575766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:50.578029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:50.602295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 886/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:50 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:50.607040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:50.618156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408bf5-7d99-490e-bda4-059aa8d6a92e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:50.625439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9752d-64f1-49b6-b714-de1b171b94ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:50.635790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9752d-64f1-49b6-b714-de1b171b94ad admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.637563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9752d-64f1-49b6-b714-de1b171b94ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.639498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9752d-64f1-49b6-b714-de1b171b94ad admin admin] PATH_INFO: `/v3/projects/eb9fe1b32bbe4dbaa3590a5011833558/users/41846f39f8eb44e58a52882876ce2df0/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.664237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9752d-64f1-49b6-b714-de1b171b94ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9fe1b32bbe4dbaa3590a5011833558, user_id=41846f39f8eb44e58a52882876ce2df0, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:50.672711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9752d-64f1-49b6-b714-de1b171b94ad admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:50.705339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 918/1804] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:50 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:50.719661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:50.722326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:50.767039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 887/1805] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:50 2021] PUT /identity/v3/projects/eb9fe1b32bbe4dbaa3590a5011833558/users/41846f39f8eb44e58a52882876ce2df0/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:50.780131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.780453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.780734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.824588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1574-97f5-45e7-9237-8d47ae06a771 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:50.830158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] MFA Rules not processed for user `41846f39f8eb44e58a52882876ce2df0`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:50.832449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:50.948238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:50.949441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:50.949733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:50.950004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:50.952614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:50.967238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 888/1806] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:50 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:50.978038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.017846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.019336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.029602 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 919/1807] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:50 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:51.074317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2a0d-87ba-409b-85cb-5b271d60a5f2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.081250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.082510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.083805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.084200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.085381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.087768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.205058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 889/1808] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:50 2021] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:51.206754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.225691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40f95-812a-408f-93ea-971b2ae84ed8 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.299027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.299747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.300183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.300507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.301240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.303149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.409554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 920/1809] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:51 2021] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:51.416849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.427757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173686ad-a499-4aef-9c0f-8952044e70bb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.434632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.435311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.435595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.435872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.436636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.438739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.450119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 890/1810] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:51 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:51.454453 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.475404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de89626-5d3c-4f80-89af-a7f2a57a6f36 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.481656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.483280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.483788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.484283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] PATH_INFO: `/v3/projects/1078cdc4c5734076b93e298124ed9321/users/4cd1f091f7984ef5b8ff1eadaed51f24/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.507525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1078cdc4c5734076b93e298124ed9321, user_id=4cd1f091f7984ef5b8ff1eadaed51f24, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.511122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.606061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 921/1811] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:51 2021] PUT /identity/v3/projects/1078cdc4c5734076b93e298124ed9321/users/4cd1f091f7984ef5b8ff1eadaed51f24/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:51.609780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.621231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0cd3e-faed-4f9e-b752-c9053ed1ed24 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.685608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9981747-990f-424c-ba97-c5c701993e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.687916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981747-990f-424c-ba97-c5c701993e49 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.688693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981747-990f-424c-ba97-c5c701993e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.689157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981747-990f-424c-ba97-c5c701993e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.690132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9981747-990f-424c-ba97-c5c701993e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.692096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9981747-990f-424c-ba97-c5c701993e49 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.707273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 891/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:51 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:51.709347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.720046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd3577-64bb-4d03-90bc-75532b463d2c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.725479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.726608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.726964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.727310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] PATH_INFO: `/v3/projects/1078cdc4c5734076b93e298124ed9321/users/4cd1f091f7984ef5b8ff1eadaed51f24/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.730036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1078cdc4c5734076b93e298124ed9321, user_id=4cd1f091f7984ef5b8ff1eadaed51f24, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.735922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.749582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 922/1813] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:51 2021] PUT /identity/v3/projects/1078cdc4c5734076b93e298124ed9321/users/4cd1f091f7984ef5b8ff1eadaed51f24/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:51.761169 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.764588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.764588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.788951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] MFA Rules not processed for user `4cd1f091f7984ef5b8ff1eadaed51f24`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:51.790243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:51.877972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 892/1814] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:51 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:51.888526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:51.946273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df668-fda5-4341-a694-0e21a1a97288 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:51.950292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:51.950961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:51.951252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:51.951538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:51.962764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:51.964722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:51.982135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 923/1815] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:51 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:53.065360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:53.075815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c87621-a9a6-469a-b1a8-51655bcabe23 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:53.080023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:53.080804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:53.081094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:53.081369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:53.143591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:53.145109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:53.154821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 893/1816] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:53 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:53.738186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:53.815218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03668a92-bf03-4bd9-976f-ebaa8eec0a0e service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:53.819980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:53.827308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:53.827308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:53.827308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] PATH_INFO: `/v3/users/41846f39f8eb44e58a52882876ce2df0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:53.827308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41846f39f8eb44e58a52882876ce2df0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:53.827308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:54.050262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41846f39f8eb44e58a52882876ce2df0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:54.142483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:54.151725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe607a-f88f-499a-abd9-b1e303ce5fa6 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:54.155431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:54.156129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:54.156456 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:54.156771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:54.158720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:54.171742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41846f39f8eb44e58a52882876ce2df0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:54.187599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41846f39f8eb44e58a52882876ce2df0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:54.195060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41846f39f8eb44e58a52882876ce2df0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:54.199456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3accbfac-2142-4923-951d-7bc3edc385b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41846f39f8eb44e58a52882876ce2df0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:54.203976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 924/1817] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:53 2021] DELETE /identity/v3/users/41846f39f8eb44e58a52882876ce2df0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:54.208478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:54.208832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:54.209063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:54.234136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:54.235851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:54.248630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:54.248630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:54.257038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 894/1818] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:54 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:25:54.314912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 925/1819] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:54.320969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:54.327202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:54.390097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70a3e-b1e3-456c-a066-e5fdcfeaac4e service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:54.437617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:54.438273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:54.438557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:54.438835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:54.448675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:54.450099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:54.459851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 895/1820] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:54.998764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:55.000367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:55.032594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3fc84-c4bc-4d04-9153-0b8b0c6814bd None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:55.037806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:55.038733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:55.038965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:55.039244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] PATH_INFO: `/v3/projects/eb9fe1b32bbe4dbaa3590a5011833558` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:55.041000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9fe1b32bbe4dbaa3590a5011833558)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:55.042869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:55.184895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9fe1b32bbe4dbaa3590a5011833558', 'request_id': 'req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.190195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9fe1b32bbe4dbaa3590a5011833558', 'request_id': 'req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.198865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9fe1b32bbe4dbaa3590a5011833558', 'request_id': 'req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.369218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] The token cache is being invalidate because project eb9fe1b32bbe4dbaa3590a5011833558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:55.369775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.370586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.373097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 926/1821] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:54 2021] DELETE /identity/v3/projects/eb9fe1b32bbe4dbaa3590a5011833558 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:55.377262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:55.409899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace25d5-053a-4a6d-8d1d-a5bbe3f42980 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:55.511100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:55.512109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:55.512407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:55.512720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] PATH_INFO: `/v3/users/4cd1f091f7984ef5b8ff1eadaed51f24` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:55.513907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd1f091f7984ef5b8ff1eadaed51f24)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:55.515887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:55.756966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd1f091f7984ef5b8ff1eadaed51f24'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.757713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd1f091f7984ef5b8ff1eadaed51f24'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.758367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd1f091f7984ef5b8ff1eadaed51f24'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.846656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd1f091f7984ef5b8ff1eadaed51f24'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.859875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f642918c-22eb-4a64-a7d9-6ce3c4c25b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd1f091f7984ef5b8ff1eadaed51f24'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:55.877042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 896/1822] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:55 2021] DELETE /identity/v3/users/4cd1f091f7984ef5b8ff1eadaed51f24 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:56.502801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:56.504901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:56.522721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03bf5a-bb4b-43b8-b433-e6a2e2f8ce0f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:56.606724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:56.607649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:56.607898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:56.608348 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] PATH_INFO: `/v3/projects/1078cdc4c5734076b93e298124ed9321` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:56.609604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1078cdc4c5734076b93e298124ed9321)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:56.612471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:56.782013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1078cdc4c5734076b93e298124ed9321', 'request_id': 'req-670835e6-910b-40b6-a7da-f81b46e1ef8a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:56.788943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1078cdc4c5734076b93e298124ed9321', 'request_id': 'req-670835e6-910b-40b6-a7da-f81b46e1ef8a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:56.797954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1078cdc4c5734076b93e298124ed9321', 'request_id': 'req-670835e6-910b-40b6-a7da-f81b46e1ef8a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:56.893572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] The token cache is being invalidate because project 1078cdc4c5734076b93e298124ed9321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:25:56.893872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:56.894560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-670835e6-910b-40b6-a7da-f81b46e1ef8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:25:56.896551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 927/1823] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:25:56 2021] DELETE /identity/v3/projects/1078cdc4c5734076b93e298124ed9321 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:56.902801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:56.903279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:56.903394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:56.923515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:56.924741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:56.982313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 897/1824] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:56.990216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:56.990515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:56.990913 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.008684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:57.010503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:57.018404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 928/1825] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:57.023010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.033731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c558-f7a6-486b-9b37-cb21c8847e8c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.038537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.039230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.039498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.039840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.040610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:25:57.040923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.042667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:57.054511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 898/1826] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:25:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:25:57.059007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.068191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feb7e3-6273-43f6-955c-2ed3ec52c3d7 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.073642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.074298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.074586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.074863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.075588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.077509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:57.207794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 929/1827] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:57 2021] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:25:57.212144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.223681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ac0b-584f-4574-bf7b-49571c5ce874 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.280245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.280948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.281233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.281510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.282197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.284111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:57.452463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 899/1828] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:57 2021] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:57.457469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.471598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba0ac-df62-4e3e-88f8-61a0efeea000 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.481341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.482115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.482388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.482665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.483785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.485195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:57.506739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 930/1829] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:57 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:57.507690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.519857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967872-9ad2-401b-8d0b-27d3b2979507 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.525996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a4e93-d239-4c34-9136-168514861b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.527242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a4e93-d239-4c34-9136-168514861b6e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.527360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a4e93-d239-4c34-9136-168514861b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.527747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a4e93-d239-4c34-9136-168514861b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.528790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a4e93-d239-4c34-9136-168514861b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.533330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a4e93-d239-4c34-9136-168514861b6e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:57.543500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 900/1830] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:57 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:57.547593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.560680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054f2b-342a-4072-b470-bed39b3114c2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.576961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.579389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.579389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.579389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] PATH_INFO: `/v3/projects/edb0a2af83a045bbaa05f194ec50555f/users/1bee209245384078b7915a6695107e83/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.601836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb0a2af83a045bbaa05f194ec50555f, user_id=1bee209245384078b7915a6695107e83, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.619316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:57.758590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 931/1831] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:57 2021] PUT /identity/v3/projects/edb0a2af83a045bbaa05f194ec50555f/users/1bee209245384078b7915a6695107e83/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:57.777933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.778312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.778673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.812118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] MFA Rules not processed for user `1bee209245384078b7915a6695107e83`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:57.813698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:57.917192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 901/1832] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:57 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:25:57.919755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:57.986147 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703f3d3-b378-4945-b0f1-4dd49a776d67 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:57.991058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:57.995896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:57.995896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:57.995896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:57.995896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:57.995896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:58.087848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 932/1833] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:25:57 2021] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:58.088185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:58.097796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fab59-0ee7-4a3a-978f-4e2fec2fd4e6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:58.166278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:58.167464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:58.168114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:58.168590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:58.169713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:58.172022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:58.283242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 902/1834] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:25:58 2021] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:25:58.287248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:58.298317 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b39e41-9a19-482c-8e2e-a16fabb01c63 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:58.303344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:58.304253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:58.304588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:58.304928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:58.305673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:58.307291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:58.318383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 933/1835] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:25:58.323842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:58.334011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c8567-d141-4131-9ab4-55d7e4ea677a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:58.339531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:58.340533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:58.340849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:58.341120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] PATH_INFO: `/v3/projects/84cc9a15bf3b40d4b1dc46dcc3650d42/users/9e0e531d8c7c40b6b1fc65adead5b54d/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:58.356585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cc9a15bf3b40d4b1dc46dcc3650d42, user_id=9e0e531d8c7c40b6b1fc65adead5b54d, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:58.359272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:58.484344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 903/1836] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:58 2021] PUT /identity/v3/projects/84cc9a15bf3b40d4b1dc46dcc3650d42/users/9e0e531d8c7c40b6b1fc65adead5b54d/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:25:58.488316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:58.498308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4d0a6-5e1f-4a33-bd3e-7afeb2549699 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:58.554929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fc19b-80ef-434f-96ef-2fa46430e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:58.556369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fc19b-80ef-434f-96ef-2fa46430e0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:58.556685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fc19b-80ef-434f-96ef-2fa46430e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:58.556964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fc19b-80ef-434f-96ef-2fa46430e0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:58.557694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fc19b-80ef-434f-96ef-2fa46430e0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:58.559256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fc19b-80ef-434f-96ef-2fa46430e0d6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:58.569166 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 934/1837] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:25:58 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:25:58.574042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:58.584242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c623e0d-96a0-4dcb-8335-851b4737ce99 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:58.589520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:58.594025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:58.594025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:58.594025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] PATH_INFO: `/v3/projects/84cc9a15bf3b40d4b1dc46dcc3650d42/users/9e0e531d8c7c40b6b1fc65adead5b54d/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:58.594025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cc9a15bf3b40d4b1dc46dcc3650d42, user_id=9e0e531d8c7c40b6b1fc65adead5b54d, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:58.595533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:58.613318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 904/1838] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:25:58 2021] PUT /identity/v3/projects/84cc9a15bf3b40d4b1dc46dcc3650d42/users/9e0e531d8c7c40b6b1fc65adead5b54d/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:25:58.623162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:58.623463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:58.623748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:58.650835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] MFA Rules not processed for user `9e0e531d8c7c40b6b1fc65adead5b54d`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:25:58.652045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:58.720380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 935/1839] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:25:58 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:25:59.006915 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:59.008817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:25:59.073679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb97ee9-045d-4d37-8fbe-794473a1f185 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:25:59.078479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:25:59.078759 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:25:59.078844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:25:59.079089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:25:59.090619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:25:59.092433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:25:59.104100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 905/1840] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:25:59 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:25:59.997545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:25:59.999017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:00.114145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f9dd5-5ee9-44a5-a196-964162f9c24d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:00.129183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:00.134617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:00.135136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:00.135460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] PATH_INFO: `/v3/users/3af11637c4674894bd833d4992391773` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:00.141260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af11637c4674894bd833d4992391773)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:00.142115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:00.442641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af11637c4674894bd833d4992391773'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.511668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:00.526194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590afc-3f78-4427-839c-fe89ebd80cdb service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:00.531822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:00.533283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:00.533777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:00.534345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] PATH_INFO: `/v3/users/1bee209245384078b7915a6695107e83` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:00.535784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bee209245384078b7915a6695107e83)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:00.538295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:00.572273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af11637c4674894bd833d4992391773'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.586568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af11637c4674894bd833d4992391773'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.594258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af11637c4674894bd833d4992391773'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.594989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-57887798-7eaf-44f8-b29b-03eec45aa2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af11637c4674894bd833d4992391773'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.601599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 936/1841] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:25:59 2021] DELETE /identity/v3/users/3af11637c4674894bd833d4992391773 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:00.607197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:00.607494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:00.608279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:00.626596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:00.631415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:00.697470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 937/1842] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:00.707048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:00.708642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:00.734157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bee209245384078b7915a6695107e83'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.735001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bee209245384078b7915a6695107e83'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.735717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bee209245384078b7915a6695107e83'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.775279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a4c3-10c3-4323-8ba9-a1c25f4e51ce None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:00.779057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:00.779711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:00.779992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:00.780333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:00.782033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:00.793780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:00.795184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648e4c3-9fbd-4d32-9d9a-62b8c7fbf62b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:00.803450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bee209245384078b7915a6695107e83'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.805334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 938/1843] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:00.817629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bee209245384078b7915a6695107e83'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:00.835725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 906/1844] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:00 2021] DELETE /identity/v3/users/1bee209245384078b7915a6695107e83 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:00.838662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:00.838662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:00.838662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:00.866097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:00.867218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:00.946191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 939/1845] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:00.956058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:00.957603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:01.019039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9b3f-06e6-40f2-89a8-7eb1e8b0e434 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:01.025910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:01.031572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:01.031572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:01.031572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:01.038678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:01.040796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:01.051963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 907/1846] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:01.291664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:01.299084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:01.309350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7413a-b305-4f66-9ed5-3581e306bd84 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:01.314527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:01.315473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:01.315952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:01.316234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] PATH_INFO: `/v3/projects/7164a55e727b4c24b1309afd1c041b78` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:01.317693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7164a55e727b4c24b1309afd1c041b78)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:01.322763 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:01.446216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7164a55e727b4c24b1309afd1c041b78', 'request_id': 'req-1db7c74e-7bf3-4020-a52d-752eb70df545'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.452395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7164a55e727b4c24b1309afd1c041b78', 'request_id': 'req-1db7c74e-7bf3-4020-a52d-752eb70df545'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.459101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7164a55e727b4c24b1309afd1c041b78', 'request_id': 'req-1db7c74e-7bf3-4020-a52d-752eb70df545'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.515324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:01.516151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:01.532905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59404fb-02e6-45d2-84c0-c922dea85a68 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:01.549800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] The token cache is being invalidate because project 7164a55e727b4c24b1309afd1c041b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:01.551290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.553575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.557650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 940/1847] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:01 2021] DELETE /identity/v3/projects/7164a55e727b4c24b1309afd1c041b78 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:01.561614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:01.564668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:01.627743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:01.628653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:01.628950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:01.629214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] PATH_INFO: `/v3/projects/edb0a2af83a045bbaa05f194ec50555f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:01.630417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb0a2af83a045bbaa05f194ec50555f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:01.632317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:01.639649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c74e-7bf3-4020-a52d-752eb70df545 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:01.647876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:01.648854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:01.649200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:01.649705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] PATH_INFO: `/v3/users/c68cd2cb32ec476783b7105cadd2ba1d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:01.650782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68cd2cb32ec476783b7105cadd2ba1d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:01.652874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:01.784536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb0a2af83a045bbaa05f194ec50555f', 'request_id': 'req-15b05715-3b7c-4ec3-851b-01e2ded6630d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.789786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb0a2af83a045bbaa05f194ec50555f', 'request_id': 'req-15b05715-3b7c-4ec3-851b-01e2ded6630d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.796168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb0a2af83a045bbaa05f194ec50555f', 'request_id': 'req-15b05715-3b7c-4ec3-851b-01e2ded6630d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.882528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] The token cache is being invalidate because project edb0a2af83a045bbaa05f194ec50555f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:01.882767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.883386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.885077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 908/1848] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:01 2021] DELETE /identity/v3/projects/edb0a2af83a045bbaa05f194ec50555f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:01.889074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:01.890398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:01.914339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68cd2cb32ec476783b7105cadd2ba1d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:01.954538 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05715-3b7c-4ec3-851b-01e2ded6630d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:01.959919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:01.960831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:01.961117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:01.961475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] PATH_INFO: `/v3/users/9e0e531d8c7c40b6b1fc65adead5b54d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:01.963663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0e531d8c7c40b6b1fc65adead5b54d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:01.965603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:01.991481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68cd2cb32ec476783b7105cadd2ba1d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.003830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68cd2cb32ec476783b7105cadd2ba1d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.011278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68cd2cb32ec476783b7105cadd2ba1d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.011973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68cd2cb32ec476783b7105cadd2ba1d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.018091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 941/1849] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:01 2021] DELETE /identity/v3/users/c68cd2cb32ec476783b7105cadd2ba1d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:02.176580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0e531d8c7c40b6b1fc65adead5b54d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.177239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0e531d8c7c40b6b1fc65adead5b54d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.177846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0e531d8c7c40b6b1fc65adead5b54d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.244322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0e531d8c7c40b6b1fc65adead5b54d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.261754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0e531d8c7c40b6b1fc65adead5b54d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.276088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 909/1850] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:01 2021] DELETE /identity/v3/users/9e0e531d8c7c40b6b1fc65adead5b54d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:02.533698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:02.535185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:02.598928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1ed7-f47d-41dd-9cf4-8bb3e4bb4b63 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:02.655610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:02.655610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:02.655610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:02.655870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] PATH_INFO: `/v3/projects/91b8867965624d8a924d01cf04727d40` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:02.657033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b8867965624d8a924d01cf04727d40)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:02.658925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:02.796841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b8867965624d8a924d01cf04727d40', 'request_id': 'req-c6f2d9dd-353a-4f72-b400-838ef92446dd'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.810881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b8867965624d8a924d01cf04727d40', 'request_id': 'req-c6f2d9dd-353a-4f72-b400-838ef92446dd'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.817500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b8867965624d8a924d01cf04727d40', 'request_id': 'req-c6f2d9dd-353a-4f72-b400-838ef92446dd'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.902581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] The token cache is being invalidate because project 91b8867965624d8a924d01cf04727d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:02.902872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.903533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:02.905318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 942/1851] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:02 2021] DELETE /identity/v3/projects/91b8867965624d8a924d01cf04727d40 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:02.909090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:02.910556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:02.923258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edddb-66eb-4c9a-b362-94850a55a45a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:02.956936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:02.959922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:02.982081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:02.982980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:02.983422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:02.983681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] PATH_INFO: `/v3/users/734873b9701b4e728d53544fd61fb115` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:02.988999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=734873b9701b4e728d53544fd61fb115)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:02.990942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:03.057189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2d9dd-353a-4f72-b400-838ef92446dd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:03.061806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:03.062656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.062938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.063210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] PATH_INFO: `/v3/projects/84cc9a15bf3b40d4b1dc46dcc3650d42` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.064435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84cc9a15bf3b40d4b1dc46dcc3650d42)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:03.066575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:03.198025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84cc9a15bf3b40d4b1dc46dcc3650d42', 'request_id': 'req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.201905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734873b9701b4e728d53544fd61fb115'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.202830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734873b9701b4e728d53544fd61fb115'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.203447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734873b9701b4e728d53544fd61fb115'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.204090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84cc9a15bf3b40d4b1dc46dcc3650d42', 'request_id': 'req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.210665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84cc9a15bf3b40d4b1dc46dcc3650d42', 'request_id': 'req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.306752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734873b9701b4e728d53544fd61fb115'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.323493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a28e1c88-973d-4c4e-a588-a2e0e7619733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734873b9701b4e728d53544fd61fb115'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.337607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 910/1852] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:02 2021] DELETE /identity/v3/users/734873b9701b4e728d53544fd61fb115 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:03.407629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] The token cache is being invalidate because project 84cc9a15bf3b40d4b1dc46dcc3650d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:03.407936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.408722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bbc10f21-f5b6-48ba-aa76-f8b0a5e647f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:03.410544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 943/1853] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:02 2021] DELETE /identity/v3/projects/84cc9a15bf3b40d4b1dc46dcc3650d42 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:03.416811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.417737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.418192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.446968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:03.448653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:03.511451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 911/1854] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:03.519660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.519956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.520294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.540876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:03.542189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:03.550641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 944/1855] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:03.555074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:03.565212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fed06-4b2f-499c-a4a1-071682e942ed None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:03.570166 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:03.570863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.571141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.571454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.572193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:03.572537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:03.574268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:03.590748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 912/1856] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:26:03.592006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:03.601450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde1a58-303c-426c-bb89-28c066807f02 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:03.607285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:03.607971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.608258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.608575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.609430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:03.611388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:03.785784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 945/1857] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:03 2021] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:03.789657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:03.799963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826416-4b71-4668-b122-e12752ebc742 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:03.876490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:03.877181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.877469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.877748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.878439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:03.880352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:03.917996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:03.919973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:03.935066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c3a24-bec2-4153-8ccf-1fa9f45beef8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:03.940033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:03.941176 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:03.941467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:03.941918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] PATH_INFO: `/v3/projects/4ce4853012ac4199ad14105a37b3213f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:03.943149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce4853012ac4199ad14105a37b3213f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:03.945126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:03.985815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 913/1858] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:03 2021] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:03.992282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.001720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f62f20-268c-4483-81ea-1eb392f127ef admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.006221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.006861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.007144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.007420 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.008134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.010303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.020489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 914/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:04.024358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.034375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5da52-8e60-41a3-aad3-16cb00033cf7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.039088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.043507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.043507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.043507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.043507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.043507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.053804 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 915/1860] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:04.057553 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.060319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce4853012ac4199ad14105a37b3213f', 'request_id': 'req-6ade36c6-177f-4cb3-a808-71c217b94558'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:04.065877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce4853012ac4199ad14105a37b3213f', 'request_id': 'req-6ade36c6-177f-4cb3-a808-71c217b94558'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:04.067654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257499f5-80b7-42e6-b951-d3288527e4d5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.073150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce4853012ac4199ad14105a37b3213f', 'request_id': 'req-6ade36c6-177f-4cb3-a808-71c217b94558'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:04.123149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c379eb6-cb5b-491e-bbe1-41ab657604cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.124048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379eb6-cb5b-491e-bbe1-41ab657604cf admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.124332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379eb6-cb5b-491e-bbe1-41ab657604cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.124641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379eb6-cb5b-491e-bbe1-41ab657604cf admin admin] PATH_INFO: `/v3/projects/a23b1cdbcd6440e3990f5df30e7eb7ed/users/9467206927a64bdea94dcb88f912872c/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.139296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c379eb6-cb5b-491e-bbe1-41ab657604cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23b1cdbcd6440e3990f5df30e7eb7ed, user_id=9467206927a64bdea94dcb88f912872c, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.142094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c379eb6-cb5b-491e-bbe1-41ab657604cf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.154043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] The token cache is being invalidate because project 4ce4853012ac4199ad14105a37b3213f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:04.154336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:04.154992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6ade36c6-177f-4cb3-a808-71c217b94558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:04.157719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 946/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:03 2021] DELETE /identity/v3/projects/4ce4853012ac4199ad14105a37b3213f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:04.163166 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455445f-e537-4246-a2d7-79b6d45af406 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.163462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455445f-e537-4246-a2d7-79b6d45af406 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.163744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455445f-e537-4246-a2d7-79b6d45af406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.181562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6455445f-e537-4246-a2d7-79b6d45af406 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:04.182769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6455445f-e537-4246-a2d7-79b6d45af406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:04.191720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 947/1862] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:04.200256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.200580 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.200862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.219083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:04.220388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:04.226898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 916/1863] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:04 2021] PUT /identity/v3/projects/a23b1cdbcd6440e3990f5df30e7eb7ed/users/9467206927a64bdea94dcb88f912872c/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:04.230017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.230560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.230838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.268406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] MFA Rules not processed for user `9467206927a64bdea94dcb88f912872c`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:04.269700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:04.301082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 948/1864] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:04.301639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.312252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0702d4-7a59-4ad6-81eb-08baf6833b55 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.317863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.318828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.319312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.319931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.320878 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:04.321491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.323332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.340035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 949/1865] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:26:04.341252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.353229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db33a3-39d6-4081-8a6c-0a33ba848ce7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.356462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 917/1866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:04 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:04.358443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.359466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.359822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.360161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.361102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.363050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.363933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.366821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:04.445883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce43ee5-aa60-4a2b-b619-caae63527e18 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.450242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.461079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.461287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.461579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.485049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.486425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 950/1867] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:04 2021] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:04.486634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.487525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.519263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 918/1868] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:04 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:04.580730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3915ec-2cc6-4851-ae26-a3e4affbdb67 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.586139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93782-172b-4235-9973-562de552d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.587573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93782-172b-4235-9973-562de552d248 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.587902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93782-172b-4235-9973-562de552d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.588183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93782-172b-4235-9973-562de552d248 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.588933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93782-172b-4235-9973-562de552d248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.591329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93782-172b-4235-9973-562de552d248 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.707773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 951/1869] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:04 2021] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:04.714248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.728595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21c47-1521-4c19-8262-e2014638e9fd service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.733964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.738253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.738253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.738253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.738253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.738253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.750488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 919/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:04.754485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93782-172b-4235-9973-562de552d248 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.769128 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93782-172b-4235-9973-562de552d248 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.775029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca18c95-db8f-4031-843f-e30ceea41451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.775659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18c95-db8f-4031-843f-e30ceea41451 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.775950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18c95-db8f-4031-843f-e30ceea41451 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.776228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18c95-db8f-4031-843f-e30ceea41451 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.777023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca18c95-db8f-4031-843f-e30ceea41451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.778754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca18c95-db8f-4031-843f-e30ceea41451 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.790664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 952/1871] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:04.798764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:04.808780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064244b-c52a-43d2-afc4-a6ea8b229a18 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:04.815377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:04.817042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.817346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.817612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] PATH_INFO: `/v3/projects/0e81c2be1c804febbd90f96b64dec852/users/53bfe0add1554fae97bb125959f7f9c0/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:04.836841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e81c2be1c804febbd90f96b64dec852, user_id=53bfe0add1554fae97bb125959f7f9c0, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:04.840280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:04.975760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 920/1872] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:04 2021] PUT /identity/v3/projects/0e81c2be1c804febbd90f96b64dec852/users/53bfe0add1554fae97bb125959f7f9c0/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:04.991779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:04.992082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:04.992487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.042281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] MFA Rules not processed for user `53bfe0add1554fae97bb125959f7f9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:05.043690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:05.125543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 953/1873] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:04 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:05.130218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:05.206973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09df10-d50a-4321-933d-ac9b161f227a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:05.213731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:05.214592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.214890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.215171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.215879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:05.218017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:05.343122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 921/1874] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:05 2021] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:05.344361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:05.357278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31a56c-6aae-426e-9b1a-aa24c26773d2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:05.420402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:05.421232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.421623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.422030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.422888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:05.424906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:05.602357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 954/1875] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:05 2021] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:05.607126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:05.617746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1e54-7203-4e16-bef9-73554e8f7263 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:05.622819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:05.623497 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.623786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.624062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.625006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:05.626496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:05.639825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 922/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:05.643774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:05.654690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877281f7-6da7-48c1-b6b9-54238692b1cf admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:05.659565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:05.660529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.664022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.664022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] PATH_INFO: `/v3/projects/68289eacd1bc454f9ff676b2a76f3ee6/users/476816b21b78476faa0edc463fe2503d/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.679571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68289eacd1bc454f9ff676b2a76f3ee6, user_id=476816b21b78476faa0edc463fe2503d, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:05.682376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:05.768678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 955/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:05 2021] PUT /identity/v3/projects/68289eacd1bc454f9ff676b2a76f3ee6/users/476816b21b78476faa0edc463fe2503d/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:05.772584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:05.782668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b8162-1e07-4ef6-a3bd-a882294ea0a5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:05.837890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99afa-929a-482c-89c2-eea8f8895997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:05.838493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99afa-929a-482c-89c2-eea8f8895997 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.838775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99afa-929a-482c-89c2-eea8f8895997 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.839051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99afa-929a-482c-89c2-eea8f8895997 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.839767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99afa-929a-482c-89c2-eea8f8895997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:05.841385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99afa-929a-482c-89c2-eea8f8895997 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:05.851097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 923/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:05.856131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:05.866746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55e642-f9e2-4ba9-9734-ad5d7bbb1d26 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:05.871459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:05.872360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.872681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.872955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] PATH_INFO: `/v3/projects/68289eacd1bc454f9ff676b2a76f3ee6/users/476816b21b78476faa0edc463fe2503d/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.875529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68289eacd1bc454f9ff676b2a76f3ee6, user_id=476816b21b78476faa0edc463fe2503d, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:05.881156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:05.891548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 956/1879] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:05 2021] PUT /identity/v3/projects/68289eacd1bc454f9ff676b2a76f3ee6/users/476816b21b78476faa0edc463fe2503d/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:05.902963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:05.903251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:05.903532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:05.928937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] MFA Rules not processed for user `476816b21b78476faa0edc463fe2503d`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:05.930118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:05.996037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 924/1880] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:05 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:06.006694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:06.061911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d227e-2447-4819-9928-f7af49cf4376 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:06.066141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:06.066387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:06.066553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:06.066835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:06.076397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:06.077838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:06.088021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 957/1881] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:06 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:06.287865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:06.297283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa265e2-719c-4c9e-816a-6d1ebf1f1ed3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:06.302063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7ea3-f7ca-47f8-bde9-250a71dc2a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:06.302063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7ea3-f7ca-47f8-bde9-250a71dc2a42 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:06.302063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7ea3-f7ca-47f8-bde9-250a71dc2a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:06.302370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7ea3-f7ca-47f8-bde9-250a71dc2a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:06.358949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d7ea3-f7ca-47f8-bde9-250a71dc2a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:06.360383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d7ea3-f7ca-47f8-bde9-250a71dc2a42 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:06.371121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 925/1882] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:06 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:07.057595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:07.121935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4bda3-6655-4614-a828-f69012b64146 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:07.126618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:07.127522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:07.127813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:07.128094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] PATH_INFO: `/v3/users/53bfe0add1554fae97bb125959f7f9c0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:07.129350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bfe0add1554fae97bb125959f7f9c0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:07.135307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:07.359197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bfe0add1554fae97bb125959f7f9c0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:07.441482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bfe0add1554fae97bb125959f7f9c0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:07.455080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bfe0add1554fae97bb125959f7f9c0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:07.463224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bfe0add1554fae97bb125959f7f9c0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:07.466853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bfe0add1554fae97bb125959f7f9c0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:07.471700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 958/1883] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:07 2021] DELETE /identity/v3/users/53bfe0add1554fae97bb125959f7f9c0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:07.476283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:07.476839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:07.476932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:07.498516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:07.500796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:07.574624 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 926/1884] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:07.585080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:07.586527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:07.651390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e1e3-ffa2-45c1-b88d-fb6f5813c960 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:07.655268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:07.655926 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:07.656215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:07.656521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:07.667954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:07.669655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:07.679426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 959/1885] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:08.181258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:08.182946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:08.207370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f255faf-bb1c-4267-9b21-c4eac08b37b7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:08.212393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:08.213537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:08.213879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:08.214161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] PATH_INFO: `/v3/projects/0e81c2be1c804febbd90f96b64dec852` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:08.218884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e81c2be1c804febbd90f96b64dec852)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:08.221108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:08.343313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e81c2be1c804febbd90f96b64dec852', 'request_id': 'req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.349036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e81c2be1c804febbd90f96b64dec852', 'request_id': 'req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.359233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e81c2be1c804febbd90f96b64dec852', 'request_id': 'req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.442558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] The token cache is being invalidate because project 0e81c2be1c804febbd90f96b64dec852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:08.444776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.444776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.445248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 927/1886] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:08 2021] DELETE /identity/v3/projects/0e81c2be1c804febbd90f96b64dec852 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:08.449196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:08.458750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11083f2b-3110-4351-8eef-8f2af63e888a service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:08.513381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:08.514254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:08.514541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:08.514857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] PATH_INFO: `/v3/users/476816b21b78476faa0edc463fe2503d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:08.516001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476816b21b78476faa0edc463fe2503d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:08.517949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:08.740553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476816b21b78476faa0edc463fe2503d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.830986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476816b21b78476faa0edc463fe2503d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.846535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476816b21b78476faa0edc463fe2503d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.854164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476816b21b78476faa0edc463fe2503d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.854962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476816b21b78476faa0edc463fe2503d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:08.861276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 960/1887] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:08 2021] DELETE /identity/v3/users/476816b21b78476faa0edc463fe2503d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:09.346848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:09.348301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:09.365723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d5d3-c4ea-43a3-bf13-fe92c945d0cb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:09.383927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:09.385366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:09.421160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:09.422026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.422311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.422592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] PATH_INFO: `/v3/projects/68289eacd1bc454f9ff676b2a76f3ee6` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.423771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68289eacd1bc454f9ff676b2a76f3ee6)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:09.425701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:09.447583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1c1bd-bb77-4701-b2dc-8f4e81390540 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:09.452291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:09.453244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.453534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.453818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] PATH_INFO: `/v3/users/9467206927a64bdea94dcb88f912872c` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.455028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9467206927a64bdea94dcb88f912872c)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:09.457109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:09.555138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68289eacd1bc454f9ff676b2a76f3ee6', 'request_id': 'req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.564724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68289eacd1bc454f9ff676b2a76f3ee6', 'request_id': 'req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.571085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68289eacd1bc454f9ff676b2a76f3ee6', 'request_id': 'req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.639606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] The token cache is being invalidate because project 68289eacd1bc454f9ff676b2a76f3ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:09.639903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.640560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bbc3d453-11d4-42e2-b68f-5d795c2eb57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.643437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 928/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:09 2021] DELETE /identity/v3/projects/68289eacd1bc454f9ff676b2a76f3ee6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:09.647800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9467206927a64bdea94dcb88f912872c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.648912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfa577-a264-47a9-a949-7592d9cf775a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.649175 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfa577-a264-47a9-a949-7592d9cf775a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.650026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfa577-a264-47a9-a949-7592d9cf775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.667941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-80cfa577-a264-47a9-a949-7592d9cf775a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:09.669185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-80cfa577-a264-47a9-a949-7592d9cf775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:09.724737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 929/1889] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:09.731621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9467206927a64bdea94dcb88f912872c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.733213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.733523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.733794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.744969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9467206927a64bdea94dcb88f912872c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.751444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9467206927a64bdea94dcb88f912872c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.751716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:09.752266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bfd8db45-eb7f-4b41-b5d9-047f821afb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9467206927a64bdea94dcb88f912872c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:09.752982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:09.758273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 961/1890] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:09 2021] DELETE /identity/v3/users/9467206927a64bdea94dcb88f912872c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:09.764255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 930/1891] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:09.764391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.764391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.764391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.765258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:09.774540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53649e-2fec-4a7b-b085-54c012082745 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:09.780549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:09.781745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:09.833974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:09.834774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.835152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.835510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.836336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:09.836743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:09.838432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:09.841416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 962/1892] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:09.850757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 931/1893] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:26:09.855499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:09.857042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:09.857485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:09.869474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b2ae-2d7a-49b4-a862-2b55c0139785 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:09.875516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:09.876461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.876995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.877423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.878297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:09.880341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:09.916087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f22f-37c1-4267-be3b-ee4bedacac9f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:09.919859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:09.920542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:09.920827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:09.921104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:09.930065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:09.932028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:09.941219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 963/1894] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:10.048510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 932/1895] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:09 2021] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:10.049635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.059770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54221-e156-4c35-956f-60861f62ad11 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.114471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.115157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.115422 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.115711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.116403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.118356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.202865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 964/1896] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:10.206994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.218369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a8d9-7768-4f34-898d-3cd439757ef3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.223525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.224269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.224600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.224882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.225607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.227194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.239818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 933/1897] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:10.243401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.254019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25cf55-3083-4215-a262-fd4a3246597b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.258634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.259328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.259614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.259888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.260676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.262258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.272586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 965/1898] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:10.277519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.292335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b72fc-3828-4b9d-b07b-7d4f31dcfed5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.294666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf46ddd-c6c7-4f24-a8ce-1a081a1dba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.295555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46ddd-c6c7-4f24-a8ce-1a081a1dba66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.295837 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46ddd-c6c7-4f24-a8ce-1a081a1dba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.296111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46ddd-c6c7-4f24-a8ce-1a081a1dba66 admin admin] PATH_INFO: `/v3/projects/4cc51c6cf30545ba85cdbf123ddf3a0c/users/48f74fbce64b49ba8f29f3d98f5f9eba/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.311038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf46ddd-c6c7-4f24-a8ce-1a081a1dba66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc51c6cf30545ba85cdbf123ddf3a0c, user_id=48f74fbce64b49ba8f29f3d98f5f9eba, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.313710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf46ddd-c6c7-4f24-a8ce-1a081a1dba66 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.372278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.374078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:10.392343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b84e6-828f-4ba1-ab06-f5cb1e614c82 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.404016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 934/1899] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:10 2021] PUT /identity/v3/projects/4cc51c6cf30545ba85cdbf123ddf3a0c/users/48f74fbce64b49ba8f29f3d98f5f9eba/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:10.405592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.405889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.406176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.447952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] MFA Rules not processed for user `48f74fbce64b49ba8f29f3d98f5f9eba`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:10.449205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:10.463565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.465006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.465006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.465239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] PATH_INFO: `/v3/projects/a23b1cdbcd6440e3990f5df30e7eb7ed` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.466505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23b1cdbcd6440e3990f5df30e7eb7ed)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.468536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.516038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 935/1900] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:10.520384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.535665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc35ce-f5de-48e9-b886-20386c032ab4 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.538236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.538928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.539213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.539489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.540264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.542292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.599511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23b1cdbcd6440e3990f5df30e7eb7ed', 'request_id': 'req-e2834e52-68ac-455c-b85e-b200817552c5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:10.604755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23b1cdbcd6440e3990f5df30e7eb7ed', 'request_id': 'req-e2834e52-68ac-455c-b85e-b200817552c5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:10.610917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23b1cdbcd6440e3990f5df30e7eb7ed', 'request_id': 'req-e2834e52-68ac-455c-b85e-b200817552c5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:10.739928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] The token cache is being invalidate because project a23b1cdbcd6440e3990f5df30e7eb7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:10.740227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:10.742317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 936/1901] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:10.742581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e2834e52-68ac-455c-b85e-b200817552c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:10.746284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 966/1902] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:10 2021] DELETE /identity/v3/projects/a23b1cdbcd6440e3990f5df30e7eb7ed => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:10.751135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.754188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b491db-1f63-4dfc-baba-7942353dce46 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.754503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b491db-1f63-4dfc-baba-7942353dce46 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.754770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b491db-1f63-4dfc-baba-7942353dce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.756264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:10.781183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e4b491db-1f63-4dfc-baba-7942353dce46 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:10.782586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e4b491db-1f63-4dfc-baba-7942353dce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:10.859874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82269-6007-4a6b-8802-c459926f8315 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.864661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.865411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.865766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.866048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.866731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.869183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.872892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 967/1903] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:10.880623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.880923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.881206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.899195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:10.900409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:10.908192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 968/1904] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:10.912133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.920635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454de62b-a5b7-4c45-b7a9-d57b4585d990 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.925192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.925823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.926109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.926387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.927100 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:10.927406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.928997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.940915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 969/1905] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:26:10.944960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.955270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce9611-5c00-469d-a3d7-9ae642dec9ec admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.960169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.960923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.961208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.961519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.962399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:10.964254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:10.974391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 937/1906] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:10.978389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:10.989018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b2d9-85ee-423b-a443-450e2ed36545 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:10.996493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:10.997247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:10.997607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:10.997958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:10.998756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.000656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.014703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 938/1907] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:11.015841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.026772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5028e-22b8-477a-84ae-82f5875b7e93 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.032336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.033158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.033445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.033726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.034450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.036030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.047810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 939/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:11.052644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.064896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ad71-d740-4221-88db-387432fd9fbb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.078608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 970/1909] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:10 2021] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:11.078956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e590-8ef3-4cdb-98ab-93eade83f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.078956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e590-8ef3-4cdb-98ab-93eade83f07c admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.078956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e590-8ef3-4cdb-98ab-93eade83f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.078956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e590-8ef3-4cdb-98ab-93eade83f07c admin admin] PATH_INFO: `/v3/projects/a6f043f1147e4feab0d65d2c68e71798/users/e5314c37ff0a4aea83da879a117c7be6/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.081186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.098216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19e590-8ef3-4cdb-98ab-93eade83f07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f043f1147e4feab0d65d2c68e71798, user_id=e5314c37ff0a4aea83da879a117c7be6, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.102056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19e590-8ef3-4cdb-98ab-93eade83f07c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.157812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59eee3-44dd-45b6-8c5b-0708afb6c91d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.162636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.163322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.163611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.165838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.165838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.167130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.191367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 940/1910] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:11 2021] PUT /identity/v3/projects/a6f043f1147e4feab0d65d2c68e71798/users/e5314c37ff0a4aea83da879a117c7be6/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:11.202939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.203233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.203518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.247446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] MFA Rules not processed for user `e5314c37ff0a4aea83da879a117c7be6`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:11.248815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:11.268522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 971/1911] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:11 2021] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:11.272261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.295415 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27279ed-4c84-46dc-809f-1478358fde77 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.333502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 941/1912] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:11 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:11.334533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.353690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.354618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.355310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.355592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.356550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.358317 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.369341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 972/1913] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:11.373379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.386688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2c262-9efc-4a10-924f-23225dada621 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.392340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.393071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.393811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.393811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.394377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.395939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.397278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ce9d2-8179-41cd-97c4-d31dc945782a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.402811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.403493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.403777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.404086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.404816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.406702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.407822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 973/1914] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:11.411515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.422378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894d6d9-847f-4685-bcd9-2c2a5a144485 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.427352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37a8f-ef6e-430b-ac6f-8c02aff0f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.428413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37a8f-ef6e-430b-ac6f-8c02aff0f251 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.428900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37a8f-ef6e-430b-ac6f-8c02aff0f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.429181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37a8f-ef6e-430b-ac6f-8c02aff0f251 admin admin] PATH_INFO: `/v3/projects/bd59c539cbc6460ca8591f034a307f84/users/50f7b138d4bf4a2195df785ed52322a5/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.444501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37a8f-ef6e-430b-ac6f-8c02aff0f251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd59c539cbc6460ca8591f034a307f84, user_id=50f7b138d4bf4a2195df785ed52322a5, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.447739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37a8f-ef6e-430b-ac6f-8c02aff0f251 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.489992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 942/1915] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:11 2021] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:11.493887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.543889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 974/1916] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:11 2021] PUT /identity/v3/projects/bd59c539cbc6460ca8591f034a307f84/users/50f7b138d4bf4a2195df785ed52322a5/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:11.554980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.555455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.556922 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf762b2-6b85-4924-95fd-2bc867435243 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.559272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.587854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] MFA Rules not processed for user `50f7b138d4bf4a2195df785ed52322a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:11.589346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:11.624653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.625385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.625676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.625954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.626639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.629055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.655118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 975/1917] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:11 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:11.669439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.674629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:11.723827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 943/1918] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:11 2021] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:11.727346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.730780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d750fb4-132b-4ef7-bee3-2290038267c0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.734980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.735318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.735607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.743213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.743434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312cdb-ebc9-4abb-9542-811aad39663b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.746201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.746827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.747521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.747782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.747902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.748077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.748903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.750528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.771881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 944/1919] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:11.771968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 976/1920] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:11 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:11.772057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.778657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac19e9f-086d-43d7-8362-da964620bc7a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.784713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:11.788353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.789327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.789614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.789931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] PATH_INFO: `/v3/projects/08108615370c4ee393b14ad8f3a9f5f7/users/b532aecf0a534cb6b0516c60e2969ad6/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.797500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f740de-1179-43b4-b180-eeaa50d094db service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:11.804070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:11.805271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:11.805707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:11.806019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] PATH_INFO: `/v3/users/50f7b138d4bf4a2195df785ed52322a5` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:11.806609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=08108615370c4ee393b14ad8f3a9f5f7, user_id=b532aecf0a534cb6b0516c60e2969ad6, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.807486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f7b138d4bf4a2195df785ed52322a5)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:11.809454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.809751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:11.937185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 945/1921] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:11 2021] PUT /identity/v3/projects/08108615370c4ee393b14ad8f3a9f5f7/users/b532aecf0a534cb6b0516c60e2969ad6/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:11.938429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:12.016923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692c5a-e874-4800-9f00-24361d8296dc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:12.027068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:12.027803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.028091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.028647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.029408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:12.031074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:12.039828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f7b138d4bf4a2195df785ed52322a5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.044458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 946/1922] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:12.047141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:12.057658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4986-34ad-40ec-9c5c-ba142b881de2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:12.062422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:12.063322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.063606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.063882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] PATH_INFO: `/v3/projects/08108615370c4ee393b14ad8f3a9f5f7/users/b532aecf0a534cb6b0516c60e2969ad6/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.066131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08108615370c4ee393b14ad8f3a9f5f7, user_id=b532aecf0a534cb6b0516c60e2969ad6, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:12.069041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:12.086645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 947/1923] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:12 2021] PUT /identity/v3/projects/08108615370c4ee393b14ad8f3a9f5f7/users/b532aecf0a534cb6b0516c60e2969ad6/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:12.089367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:12.097245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.107887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f7b138d4bf4a2195df785ed52322a5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.123969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f7b138d4bf4a2195df785ed52322a5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.132134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f7b138d4bf4a2195df785ed52322a5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.136445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5942ec90-0707-421c-8a93-362b18ad2521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f7b138d4bf4a2195df785ed52322a5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.143338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 977/1924] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:11 2021] DELETE /identity/v3/users/50f7b138d4bf4a2195df785ed52322a5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:12.143338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c26b2-b988-48af-954f-506b6d7b884f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.143338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c26b2-b988-48af-954f-506b6d7b884f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.143338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c26b2-b988-48af-954f-506b6d7b884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.178879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-007c26b2-b988-48af-954f-506b6d7b884f None None] MFA Rules not processed for user `b532aecf0a534cb6b0516c60e2969ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:12.180117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-007c26b2-b988-48af-954f-506b6d7b884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.200991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3f5f-848f-472a-a98e-3690723a9c22 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:12.271839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 978/1925] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:12 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:12.271839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.271839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.271839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.286945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:12.287890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.288179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.288605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] PATH_INFO: `/v3/users/3c612d3eeca147e7b70a6121bb034681` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.289720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c612d3eeca147e7b70a6121bb034681)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:12.291895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:12.296303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:12.297800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.315165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 979/1926] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:12.328667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:12.328667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.398654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13fcb5-6922-4c9a-897d-384ad8410686 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:12.402452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:12.403098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.403390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.403664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.405421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.462740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c612d3eeca147e7b70a6121bb034681'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.463452 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c612d3eeca147e7b70a6121bb034681'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.464085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c612d3eeca147e7b70a6121bb034681'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.468054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:12.469583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:12.478618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 980/1927] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:12 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:12.479481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:12.481024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.522642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c612d3eeca147e7b70a6121bb034681'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.537461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c612d3eeca147e7b70a6121bb034681'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:12.544673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21a748-1c12-42dd-a2f8-a43e28e44d2a service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:12.549417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:12.550227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.550502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.550785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.555130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.556463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 948/1928] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:12 2021] DELETE /identity/v3/users/3c612d3eeca147e7b70a6121bb034681 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:12.570035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:12.572160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:12.582203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 981/1929] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:12.836606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:12.844766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:12.924109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bae9a-5972-4f96-8248-c5ea771e0363 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:12.928781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:12.929644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:12.929923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:12.930196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] PATH_INFO: `/v3/projects/60ee321da43a4d0c9dfac0ed66794562` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:12.931503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ee321da43a4d0c9dfac0ed66794562)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:12.934245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.055585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.057084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:13.068851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927b17b-fbad-4183-8695-b0aee6ca9822 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.074403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.076099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.076479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.076752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] PATH_INFO: `/v3/projects/bd59c539cbc6460ca8591f034a307f84` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.078143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd59c539cbc6460ca8591f034a307f84)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.080060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.112231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ee321da43a4d0c9dfac0ed66794562', 'request_id': 'req-94f1f28e-e4ff-436e-974c-8db7a4e41080'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.118693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ee321da43a4d0c9dfac0ed66794562', 'request_id': 'req-94f1f28e-e4ff-436e-974c-8db7a4e41080'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.126496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ee321da43a4d0c9dfac0ed66794562', 'request_id': 'req-94f1f28e-e4ff-436e-974c-8db7a4e41080'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.191296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd59c539cbc6460ca8591f034a307f84', 'request_id': 'req-f5375a04-0261-48b3-8553-c7cb713624d0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.198908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd59c539cbc6460ca8591f034a307f84', 'request_id': 'req-f5375a04-0261-48b3-8553-c7cb713624d0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.202998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] The token cache is being invalidate because project 60ee321da43a4d0c9dfac0ed66794562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:13.203296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.204161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.206236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 949/1930] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:12 2021] DELETE /identity/v3/projects/60ee321da43a4d0c9dfac0ed66794562 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:13.209623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd59c539cbc6460ca8591f034a307f84', 'request_id': 'req-f5375a04-0261-48b3-8553-c7cb713624d0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.212235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.214482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:13.296324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f28e-e4ff-436e-974c-8db7a4e41080 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.326952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] The token cache is being invalidate because project bd59c539cbc6460ca8591f034a307f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:13.327063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.327760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5375a04-0261-48b3-8553-c7cb713624d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.334219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 982/1931] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:13 2021] DELETE /identity/v3/projects/bd59c539cbc6460ca8591f034a307f84 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:13.335840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9057a-7801-41c9-8ab2-706c12c865fc None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.336138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9057a-7801-41c9-8ab2-706c12c865fc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.336452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9057a-7801-41c9-8ab2-706c12c865fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.356321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-edb9057a-7801-41c9-8ab2-706c12c865fc None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:13.357726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-edb9057a-7801-41c9-8ab2-706c12c865fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:13.382696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.384528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.384818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.385098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] PATH_INFO: `/v3/users/b6422d8d98314b35ba0f199f0898f990` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.386314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6422d8d98314b35ba0f199f0898f990)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.388242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.429447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 983/1932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:13.438874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.439171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.439454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.459167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:13.460579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:13.468702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 984/1933] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:13.472812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.485146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7b94d-49d0-49dc-9889-af713f6999c2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.489937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.490603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.490894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.491174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.491937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:13.492246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.494535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.508361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 985/1934] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:26:13.512850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.522594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94ff4-b121-4d79-89cd-4b6fd9a05f8a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.527587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.528253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.528634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.528927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.529749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.531656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.597027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6422d8d98314b35ba0f199f0898f990'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.597682 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6422d8d98314b35ba0f199f0898f990'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.598286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6422d8d98314b35ba0f199f0898f990'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.646587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 986/1935] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:13 2021] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:13.647775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.649372 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:13.710903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704573ae-b6c0-4976-9d2f-e59ae7aa5c9b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.715360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.716022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.716312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.716614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.717295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.719182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.733813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6422d8d98314b35ba0f199f0898f990'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.746104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6422d8d98314b35ba0f199f0898f990'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:13.757576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 950/1936] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:13 2021] DELETE /identity/v3/users/b6422d8d98314b35ba0f199f0898f990 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:13.820113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 987/1937] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:13 2021] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:13.826778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.891543 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05709ef-b219-4d8a-b64a-3bf487e85f3d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.896105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.896871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.897098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.897372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.898117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.900219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.910110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 951/1938] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:13.914195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.924699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10be852-81cd-41ea-b06b-22142649e048 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.929355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.930015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.930304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.930626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.931355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.932959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:13.942600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 988/1939] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:13.946792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:13.956513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5787-4e47-4aab-95a0-247468782c66 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:13.961133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772b700-5ba7-4a4e-b588-6ae28f4f6ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:13.962578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772b700-5ba7-4a4e-b588-6ae28f4f6ada admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:13.962866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772b700-5ba7-4a4e-b588-6ae28f4f6ada admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:13.963149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772b700-5ba7-4a4e-b588-6ae28f4f6ada admin admin] PATH_INFO: `/v3/projects/a744ae79ea894c46b13ac674ff005b59/users/b4f9ea15b91d470b953c6630e5e2c647/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:13.977439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772b700-5ba7-4a4e-b588-6ae28f4f6ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=a744ae79ea894c46b13ac674ff005b59, user_id=b4f9ea15b91d470b953c6630e5e2c647, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:13.980928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772b700-5ba7-4a4e-b588-6ae28f4f6ada admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.014250 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.016040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.029845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a404b-a107-48c5-a544-4fc9ef838921 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.035186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.036087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.036374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.036718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] PATH_INFO: `/v3/projects/ba994235abfe43998d1b10d0b51497a1` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.037895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba994235abfe43998d1b10d0b51497a1)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.040604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.076894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 952/1940] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:13 2021] PUT /identity/v3/projects/a744ae79ea894c46b13ac674ff005b59/users/b4f9ea15b91d470b953c6630e5e2c647/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:14.087462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.087776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.088082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.114320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] MFA Rules not processed for user `b4f9ea15b91d470b953c6630e5e2c647`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:14.115511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.181239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 953/1941] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:14.187813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.189667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.197320 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba994235abfe43998d1b10d0b51497a1', 'request_id': 'req-78b5b623-546b-4877-ae57-367b955cc77b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:14.203604 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba994235abfe43998d1b10d0b51497a1', 'request_id': 'req-78b5b623-546b-4877-ae57-367b955cc77b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:14.225447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba994235abfe43998d1b10d0b51497a1', 'request_id': 'req-78b5b623-546b-4877-ae57-367b955cc77b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:14.255227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb3901-b3c4-4740-aa1d-453927814fc6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.310135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414bf7c-c145-415a-a826-a9a2329937f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.310793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414bf7c-c145-415a-a826-a9a2329937f0 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.311076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414bf7c-c145-415a-a826-a9a2329937f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.311349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414bf7c-c145-415a-a826-a9a2329937f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.368667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] The token cache is being invalidate because project ba994235abfe43998d1b10d0b51497a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:14.368969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:14.372674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-78b5b623-546b-4877-ae57-367b955cc77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:14.372884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414bf7c-c145-415a-a826-a9a2329937f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.372978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 989/1942] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:14 2021] DELETE /identity/v3/projects/ba994235abfe43998d1b10d0b51497a1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:14.373513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414bf7c-c145-415a-a826-a9a2329937f0 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.377642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.378109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.378483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.383190 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 954/1943] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:14 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:14.401139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:14.402382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.469629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 990/1944] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:14.478431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.478979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.479469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.510564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:14.511892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.523890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 955/1945] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:14.525575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.539577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215996-df4a-4913-b16e-5e646071ed57 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.549862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.549862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.549862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.549862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.550509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:14.550509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.550509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.565558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 991/1946] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:26:14.566588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.578646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba19159-9e0d-431e-a08a-093252855ebb None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.585419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.586090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.586557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.587443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.588350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.590424 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.628734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.631038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.644386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a4ef-c99c-469d-a67d-d72f0bb1043b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.648542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.653360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.653360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.653360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.653360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:14.717065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.718501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.728063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 992/1947] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:14.769946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 956/1948] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:14 2021] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:14.774937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.785922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289be0-1715-4a8f-a852-fc2758b8268f service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.845054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.845739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.846028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.846307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.847017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.848937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.922908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 993/1949] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:14 2021] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:14.927174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.937275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3209d2-29f2-4722-a7ef-d1aceb848200 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.941906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.942561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.942847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.943124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.943842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.945476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.957161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 957/1950] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:14.960914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:14.971266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512a05-1cfa-4fc7-aaaa-b4ce7a5c1663 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:14.975904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4f8d1-4eca-4d83-9a8c-87319aa27cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:14.976606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f8d1-4eca-4d83-9a8c-87319aa27cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:14.976897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f8d1-4eca-4d83-9a8c-87319aa27cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:14.977175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f8d1-4eca-4d83-9a8c-87319aa27cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:14.977897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4f8d1-4eca-4d83-9a8c-87319aa27cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:14.979469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4f8d1-4eca-4d83-9a8c-87319aa27cd3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:14.992339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 994/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:14.993784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:15.004570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3d1e3-dcd4-4996-bb97-4a26707c73b6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:15.011227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:15.012115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:15.012398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:15.012726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] PATH_INFO: `/v3/projects/9d7f294832744b868e7c9b29bcca4414/users/d198e962ad2149aeb40ec68ca27606af/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:15.029005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7f294832744b868e7c9b29bcca4414, user_id=d198e962ad2149aeb40ec68ca27606af, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:15.031841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:15.148402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 958/1952] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:14 2021] PUT /identity/v3/projects/9d7f294832744b868e7c9b29bcca4414/users/d198e962ad2149aeb40ec68ca27606af/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:15.156367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:15.156760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:15.157044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:15.183979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] MFA Rules not processed for user `d198e962ad2149aeb40ec68ca27606af`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:15.185222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:15.249449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 995/1953] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:15.281782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:15.283499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:15.341760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9cc7-e6bf-4e78-891b-d31be7b801dd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:15.345556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e76d68-45b5-4f5e-8ef5-9f95fe5f357b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:15.346207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e76d68-45b5-4f5e-8ef5-9f95fe5f357b service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:15.346490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e76d68-45b5-4f5e-8ef5-9f95fe5f357b service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:15.346770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e76d68-45b5-4f5e-8ef5-9f95fe5f357b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:15.355327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e76d68-45b5-4f5e-8ef5-9f95fe5f357b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:15.356790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e76d68-45b5-4f5e-8ef5-9f95fe5f357b service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:15.365822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 959/1954] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:15 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:15.386866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:15.464973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207d05f-df57-4576-a073-fd8e17a53487 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:15.469871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:15.470817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:15.471234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:15.471517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] PATH_INFO: `/v3/users/d198e962ad2149aeb40ec68ca27606af` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:15.472786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d198e962ad2149aeb40ec68ca27606af)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:15.474933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:15.771536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd198e962ad2149aeb40ec68ca27606af'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:15.852836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:15.853338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:15.853429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:15.877020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] MFA Rules not processed for user `19410737ca1d477b8e5258d11f2ed33e`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:15.880096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd198e962ad2149aeb40ec68ca27606af'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:15.889925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:15.906525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd198e962ad2149aeb40ec68ca27606af'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:15.914181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd198e962ad2149aeb40ec68ca27606af'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:15.914948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bc019610-499c-4ac6-9499-ebdcb8e6b6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd198e962ad2149aeb40ec68ca27606af'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:15.925660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 996/1955] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:15 2021] DELETE /identity/v3/users/d198e962ad2149aeb40ec68ca27606af => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:15.929262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64166ad1-2737-4464-90b3-47143235051e None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:15.929691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64166ad1-2737-4464-90b3-47143235051e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:15.929842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64166ad1-2737-4464-90b3-47143235051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:15.956541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-64166ad1-2737-4464-90b3-47143235051e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:15.958218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-64166ad1-2737-4464-90b3-47143235051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:15.975937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 960/1956] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:16.027598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 997/1957] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:16.037798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:16.041201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:16.119631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a001d8b-5104-475f-b836-fa155a04c970 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:16.174284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:16.174968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:16.175257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:16.175529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:16.194364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:16.194364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:16.204106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 961/1958] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:16.671325 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64166ad1-2737-4464-90b3-47143235051e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:16.673492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-64166ad1-2737-4464-90b3-47143235051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:16.686796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:16.688317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:16.698326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64166ad1-2737-4464-90b3-47143235051e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:16.704402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:16.706097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:16.706909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:16.706909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] PATH_INFO: `/v3/projects/9d7f294832744b868e7c9b29bcca4414` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:16.708273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7f294832744b868e7c9b29bcca4414)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:16.712137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:16.769143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac7ebf-1a58-4f13-b586-5b1381f739d7 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:16.771550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:16.772289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:16.772700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:16.773053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:16.774919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:16.847685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7f294832744b868e7c9b29bcca4414', 'request_id': 'req-8cd9a812-d195-45b5-82c3-0ec488625665'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:16.848612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:16.850069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793ba2e-334e-4f54-a0d3-139e1a0296d4 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:16.855674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7f294832744b868e7c9b29bcca4414', 'request_id': 'req-8cd9a812-d195-45b5-82c3-0ec488625665'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:16.860531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 962/1959] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:16 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:16.862818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7f294832744b868e7c9b29bcca4414', 'request_id': 'req-8cd9a812-d195-45b5-82c3-0ec488625665'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:16.938091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] The token cache is being invalidate because project 9d7f294832744b868e7c9b29bcca4414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:16.940246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:16.941012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8cd9a812-d195-45b5-82c3-0ec488625665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:16.943291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 998/1960] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:16 2021] DELETE /identity/v3/projects/9d7f294832744b868e7c9b29bcca4414 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:16.948900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:16.949277 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:16.949633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:16.969951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:16.971356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:17.035488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 963/1961] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:17.043801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.044093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.044373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.081673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:17.082897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:17.103751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 999/1962] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:17.111983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.122542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9112d1-db8a-4532-b64e-2a5dbe59ed7d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:17.131560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:17.131560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.131560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.131560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.131867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:17.131867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:17.133305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:17.147240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 964/1963] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:26:17.152360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.169546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27e222-086c-4bf9-a826-7e1d995f2fc4 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:17.169546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:17.169546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.169546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.169915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.169915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:17.171099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:17.276963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1000/1964] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:17 2021] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:17.278285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.288958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b8e9-c491-4ca7-845d-08b2cbbd2cbe admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:17.347697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:17.348309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.348642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.348931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.349671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:17.351585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:17.466278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 965/1965] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:17 2021] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:17.470331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.481537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8e71a-c592-47a5-adfb-03a4267a399b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:17.487607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:17.489259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.489667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.490313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.491194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:17.492955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:17.504194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1001/1966] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:17.508233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.519126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8320a-0cb2-4d04-8a88-c1b598378c77 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:17.524933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9cca-98ac-4342-ae32-812f51a5e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:17.525873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9cca-98ac-4342-ae32-812f51a5e1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.526228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9cca-98ac-4342-ae32-812f51a5e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.526626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9cca-98ac-4342-ae32-812f51a5e1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.527497 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9cca-98ac-4342-ae32-812f51a5e1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:17.529220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9cca-98ac-4342-ae32-812f51a5e1c3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:17.539562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 966/1967] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:17 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:17.543757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.554198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd1669-bea4-4aa4-9e5b-3d54c011287d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:17.558829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:17.559698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.559975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.560245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] PATH_INFO: `/v3/projects/4ae5d34c45194215b2c317fed2da0a8a/users/ff63fcb91670483392e4db4ec3982cd9/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.575082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae5d34c45194215b2c317fed2da0a8a, user_id=ff63fcb91670483392e4db4ec3982cd9, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:17.577808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:17.703968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1002/1968] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:17 2021] PUT /identity/v3/projects/4ae5d34c45194215b2c317fed2da0a8a/users/ff63fcb91670483392e4db4ec3982cd9/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:17.715037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:17.715376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:17.715660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:17.743413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] MFA Rules not processed for user `ff63fcb91670483392e4db4ec3982cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:17.744652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:17.929496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 967/1969] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:17 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:17.941153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:17.942905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:18.000540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccbdd2-af89-451d-8aa7-b34929415bc1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:18.004576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:18.009608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:18.009608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:18.009608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:18.014787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:18.016298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:18.025289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1003/1970] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:17 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:18.367150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:18.368736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:18.431884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27b2e-785b-4c35-996d-a3b6511f934f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:18.437260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:18.438160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:18.438440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:18.444551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] PATH_INFO: `/v3/users/bb1699e5584746db88a9e7e693ca5600` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:18.444551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1699e5584746db88a9e7e693ca5600)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:18.444551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:18.729825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1699e5584746db88a9e7e693ca5600'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:18.730711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1699e5584746db88a9e7e693ca5600'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:18.731312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1699e5584746db88a9e7e693ca5600'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:18.797056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1699e5584746db88a9e7e693ca5600'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:18.814209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-90a64305-1237-4039-b5e7-8532e704bf9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1699e5584746db88a9e7e693ca5600'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:18.828033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 968/1971] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:18 2021] DELETE /identity/v3/users/bb1699e5584746db88a9e7e693ca5600 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:19.284636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:19.294330 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fe6b8-86b7-4182-8664-5a9b79a4428e service glance] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:19.366251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:19.367121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:19.367408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:19.368240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] PATH_INFO: `/v3/projects/eb85d6027d644d2db02c195215edc7ce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:19.369527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb85d6027d644d2db02c195215edc7ce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:19.371729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:19.483884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb85d6027d644d2db02c195215edc7ce', 'request_id': 'req-5ceff111-a60f-468b-977d-2b9ba600500f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:19.492782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb85d6027d644d2db02c195215edc7ce', 'request_id': 'req-5ceff111-a60f-468b-977d-2b9ba600500f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:19.499862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb85d6027d644d2db02c195215edc7ce', 'request_id': 'req-5ceff111-a60f-468b-977d-2b9ba600500f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:19.669955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] The token cache is being invalidate because project eb85d6027d644d2db02c195215edc7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:19.670427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:19.671416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-5ceff111-a60f-468b-977d-2b9ba600500f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:19.673140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1004/1972] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:19 2021] DELETE /identity/v3/projects/eb85d6027d644d2db02c195215edc7ce => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:19.678861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:19.679324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:19.679672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:19.702345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:19.704031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:19.771932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 969/1973] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:19.779772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:19.780136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:19.780518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:19.799489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:19.800729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:19.809316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1005/1974] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:19.813649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:19.823440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cf755-b671-4eba-846e-3918f71bd8a0 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:19.828369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:19.829074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:19.829362 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:19.829639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:19.830368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:19.830678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:19.832828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:19.845503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 970/1975] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:26:19.849888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:19.860042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913289a-159a-4bc4-8ba6-cfd2fa6c4378 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:19.864853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:19.865742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:19.866032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:19.866388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:19.867233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:19.869173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:19.968039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1006/1976] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:19 2021] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:19.972329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:19.983138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c286-2ad1-41bf-b585-ecc52f419952 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:20.050323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:20.050949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.051234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.051512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.052232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:20.054760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:20.162344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 971/1977] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:19 2021] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:20.169189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:20.180483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d6068-d859-4703-a5e4-0488ae97e213 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:20.185125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:20.185802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.186089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.186371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.187136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:20.188835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:20.200368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1007/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:20.204253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:20.214645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e7a1-a188-4930-b87d-e3df48d2ece2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:20.238516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3ef87-7e57-458c-ade2-ecf53035c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:20.239224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3ef87-7e57-458c-ade2-ecf53035c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.239499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3ef87-7e57-458c-ade2-ecf53035c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.239786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3ef87-7e57-458c-ade2-ecf53035c8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.242132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3ef87-7e57-458c-ade2-ecf53035c8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:20.254340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3ef87-7e57-458c-ade2-ecf53035c8ea admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:20.268992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 972/1979] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:20.274672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:20.287650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ba04-955a-4cea-8a77-bda75cc06c5a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:20.297169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:20.298082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.298388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.298657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] PATH_INFO: `/v3/projects/3d54b590e2c04454aaedc3b4b342eb67/users/062f8aedf3e344749a884b4279763024/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.320413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d54b590e2c04454aaedc3b4b342eb67, user_id=062f8aedf3e344749a884b4279763024, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:20.323761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:20.403554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1008/1980] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:20 2021] PUT /identity/v3/projects/3d54b590e2c04454aaedc3b4b342eb67/users/062f8aedf3e344749a884b4279763024/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:20.452161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.452881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.456200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.485923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] MFA Rules not processed for user `062f8aedf3e344749a884b4279763024`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:20.487217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:20.569777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 973/1981] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:20 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:20.574030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:20.670455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544a840-c432-442b-ab67-afed87db2fe7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:20.675561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:20.676236 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.676851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.677153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.677862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:20.681279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:20.794387 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1009/1982] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:20 2021] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:20.798890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:20.823392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479397-d2e0-46e1-835f-09292a76b29d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:20.913290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:20.914050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:20.914503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:20.914958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:20.915920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:20.918057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:21.054005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 974/1983] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:20 2021] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:21.058345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:21.068507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207c8a-3d8d-4fe6-8f28-b3e08366c22e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:21.246189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:21.246189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:21.246189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:21.246189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:21.247327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:21.247327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:21.247327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1010/1984] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:21.247686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:21.247686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291b926-288b-42b0-b037-13434f14d8c6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:21.252153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:21.253096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:21.253096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:21.253457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] PATH_INFO: `/v3/projects/7793c426b4ec491db1b327eb675c3086/users/38f1db2d7fba4a70819cafbcad610df8/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:21.269586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7793c426b4ec491db1b327eb675c3086, user_id=38f1db2d7fba4a70819cafbcad610df8, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:21.272227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:21.494822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 975/1985] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:21 2021] PUT /identity/v3/projects/7793c426b4ec491db1b327eb675c3086/users/38f1db2d7fba4a70819cafbcad610df8/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:21.498633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:21.508661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2e86d-d04f-47e1-b413-73d10a91e271 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:21.572607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b1aa-5d0c-4394-8b28-b849ab8c1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:21.573522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b1aa-5d0c-4394-8b28-b849ab8c1656 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:21.573954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b1aa-5d0c-4394-8b28-b849ab8c1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:21.574238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b1aa-5d0c-4394-8b28-b849ab8c1656 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:21.574964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b1aa-5d0c-4394-8b28-b849ab8c1656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:21.576664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b1aa-5d0c-4394-8b28-b849ab8c1656 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:21.587504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1011/1986] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:21.591839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:21.603071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee5880-7e6a-496a-82ed-a284c6e7494a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:21.608391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:21.609934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:21.609934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:21.609934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] PATH_INFO: `/v3/projects/7793c426b4ec491db1b327eb675c3086/users/38f1db2d7fba4a70819cafbcad610df8/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:21.612033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7793c426b4ec491db1b327eb675c3086, user_id=38f1db2d7fba4a70819cafbcad610df8, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:21.614917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:21.626248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 976/1987] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:21 2021] PUT /identity/v3/projects/7793c426b4ec491db1b327eb675c3086/users/38f1db2d7fba4a70819cafbcad610df8/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:21.636673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:21.636970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:21.637256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:21.666543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] MFA Rules not processed for user `38f1db2d7fba4a70819cafbcad610df8`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:21.668094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:21.738446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1012/1988] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:21 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:21.748858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:21.751073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:21.840891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef6dbe-5e03-4ac5-9718-53f7ec1a6776 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:21.844868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce7df-26fe-4874-8e29-55a81bafde0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:21.845546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce7df-26fe-4874-8e29-55a81bafde0c service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:21.845869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce7df-26fe-4874-8e29-55a81bafde0c service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:21.846223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce7df-26fe-4874-8e29-55a81bafde0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:21.856308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce7df-26fe-4874-8e29-55a81bafde0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:21.858053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce7df-26fe-4874-8e29-55a81bafde0c service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:21.870842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 977/1989] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:21 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:22.023209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:22.025563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:22.113192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37c145-533e-4afb-8fc3-7004750ff622 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:22.126195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:22.127677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:22.128066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:22.128633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] PATH_INFO: `/v3/users/48f74fbce64b49ba8f29f3d98f5f9eba` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:22.130151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f74fbce64b49ba8f29f3d98f5f9eba)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:22.132450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:22.374112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f74fbce64b49ba8f29f3d98f5f9eba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:22.487972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f74fbce64b49ba8f29f3d98f5f9eba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:22.512885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f74fbce64b49ba8f29f3d98f5f9eba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:22.515307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f74fbce64b49ba8f29f3d98f5f9eba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:22.516173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f74fbce64b49ba8f29f3d98f5f9eba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:22.524857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1013/1990] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:22 2021] DELETE /identity/v3/users/48f74fbce64b49ba8f29f3d98f5f9eba => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:22.529035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:22.529407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:22.529767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:22.552607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:22.554189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:22.636145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 978/1991] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:22.647315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:22.649166 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:22.718905 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525b799-47d4-4d59-bca5-68690c7772d0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:22.723529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:22.723529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:22.723750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:22.723843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:22.735545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:22.737008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:22.747545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1014/1992] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:23.252607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:23.255714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:23.268173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beac3e-f5c5-448d-b5a1-390e881fb67e None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:23.273505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:23.274414 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:23.274694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:23.274987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] PATH_INFO: `/v3/projects/4cc51c6cf30545ba85cdbf123ddf3a0c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:23.276126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc51c6cf30545ba85cdbf123ddf3a0c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:23.278050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:23.505278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc51c6cf30545ba85cdbf123ddf3a0c', 'request_id': 'req-0cf25c73-4af5-45f7-b59c-c221438cd864'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:23.511199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc51c6cf30545ba85cdbf123ddf3a0c', 'request_id': 'req-0cf25c73-4af5-45f7-b59c-c221438cd864'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:23.518159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc51c6cf30545ba85cdbf123ddf3a0c', 'request_id': 'req-0cf25c73-4af5-45f7-b59c-c221438cd864'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:23.641881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] The token cache is being invalidate because project 4cc51c6cf30545ba85cdbf123ddf3a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:23.642217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:23.642823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:23.644408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 979/1993] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:23 2021] DELETE /identity/v3/projects/4cc51c6cf30545ba85cdbf123ddf3a0c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:23.648596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:23.658214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7a4a7-b1ef-4e2a-95ad-595a1f76d26a service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:23.722281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:23.723168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:23.723452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:23.723735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] PATH_INFO: `/v3/users/e5314c37ff0a4aea83da879a117c7be6` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:23.725199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5314c37ff0a4aea83da879a117c7be6)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:23.732356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:23.957798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5314c37ff0a4aea83da879a117c7be6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.039549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5314c37ff0a4aea83da879a117c7be6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.051908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5314c37ff0a4aea83da879a117c7be6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.058760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5314c37ff0a4aea83da879a117c7be6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.059434 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5314c37ff0a4aea83da879a117c7be6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.065366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1015/1994] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:23 2021] DELETE /identity/v3/users/e5314c37ff0a4aea83da879a117c7be6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:24.550245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:24.557846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:24.577734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf25c73-4af5-45f7-b59c-c221438cd864 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:24.635763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:24.636655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:24.636940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:24.637217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] PATH_INFO: `/v3/projects/a6f043f1147e4feab0d65d2c68e71798` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:24.638453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f043f1147e4feab0d65d2c68e71798)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:24.644044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:24.767817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f043f1147e4feab0d65d2c68e71798', 'request_id': 'req-ed13e065-c00d-4089-aacb-7d4dc2606a0f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.773281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f043f1147e4feab0d65d2c68e71798', 'request_id': 'req-ed13e065-c00d-4089-aacb-7d4dc2606a0f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.779224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f043f1147e4feab0d65d2c68e71798', 'request_id': 'req-ed13e065-c00d-4089-aacb-7d4dc2606a0f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.862464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] The token cache is being invalidate because project a6f043f1147e4feab0d65d2c68e71798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:24.862844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.863530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:24.865174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 980/1995] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:24 2021] DELETE /identity/v3/projects/a6f043f1147e4feab0d65d2c68e71798 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:24.870203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:24.873923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:24.891598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ae4f-e0b0-4d1d-8a1a-74bf7f7f2503 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:24.973546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:24.974431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:24.974722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:24.975087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] PATH_INFO: `/v3/users/b532aecf0a534cb6b0516c60e2969ad6` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:24.976294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b532aecf0a534cb6b0516c60e2969ad6)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:24.978784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:25.193291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:25.194777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:25.207635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e065-c00d-4089-aacb-7d4dc2606a0f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:25.212521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:25.213410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:25.213697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:25.213975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] PATH_INFO: `/v3/users/062f8aedf3e344749a884b4279763024` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:25.215139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062f8aedf3e344749a884b4279763024)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:25.217114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:25.232451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b532aecf0a534cb6b0516c60e2969ad6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.302207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b532aecf0a534cb6b0516c60e2969ad6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.314109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b532aecf0a534cb6b0516c60e2969ad6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.320449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b532aecf0a534cb6b0516c60e2969ad6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.321070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c031bbe0-d18e-4047-b99e-77e41d0d36dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b532aecf0a534cb6b0516c60e2969ad6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.326839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1016/1996] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:24 2021] DELETE /identity/v3/users/b532aecf0a534cb6b0516c60e2969ad6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:25.408110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062f8aedf3e344749a884b4279763024'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.408936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062f8aedf3e344749a884b4279763024'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.409665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062f8aedf3e344749a884b4279763024'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.536794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062f8aedf3e344749a884b4279763024'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.549450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062f8aedf3e344749a884b4279763024'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.562178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 981/1997] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:25 2021] DELETE /identity/v3/users/062f8aedf3e344749a884b4279763024 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:25.567030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:25.567251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:25.567538 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:25.590122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:25.591436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:25.660697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1017/1998] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:25.668928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:25.670846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:25.726637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a4a87-6d9e-42a7-aac0-21d8fdf528a6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:25.731036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d0a68-24a5-4cdb-9788-eda5fb7e2118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:25.731686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d0a68-24a5-4cdb-9788-eda5fb7e2118 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:25.731966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d0a68-24a5-4cdb-9788-eda5fb7e2118 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:25.732240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d0a68-24a5-4cdb-9788-eda5fb7e2118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:25.740855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d0a68-24a5-4cdb-9788-eda5fb7e2118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:25.742261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d0a68-24a5-4cdb-9788-eda5fb7e2118 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:25.752243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 982/1999] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:25.821204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:25.823649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:25.834660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390598f5-f925-4494-bb7a-97144f2e30fa None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:25.839849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:25.840885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:25.841108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:25.841543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] PATH_INFO: `/v3/projects/08108615370c4ee393b14ad8f3a9f5f7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:25.842733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08108615370c4ee393b14ad8f3a9f5f7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:25.844687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:25.968191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08108615370c4ee393b14ad8f3a9f5f7', 'request_id': 'req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.973534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08108615370c4ee393b14ad8f3a9f5f7', 'request_id': 'req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:25.980329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08108615370c4ee393b14ad8f3a9f5f7', 'request_id': 'req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.080279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] The token cache is being invalidate because project 08108615370c4ee393b14ad8f3a9f5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:26.080279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.080840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8a3a92cd-1f89-44b3-a56f-be043fdc2fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.096827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1018/2000] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:25 2021] DELETE /identity/v3/projects/08108615370c4ee393b14ad8f3a9f5f7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:26.099398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.099788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.100340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.120050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:26.121450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.190604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 983/2001] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:26.199882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.200347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.200664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.222466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:26.223962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.236306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1019/2002] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:26.237770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.249074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba4c3a-baa7-4156-9a3f-efe514d9f9a6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.253893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.254447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.254730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.255002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.255758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:26.256067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.257733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.274671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 984/2003] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:26:26.275833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.285568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954bfa1-9503-4e8f-b4a3-8dc7b067cb72 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.291161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.294058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.294058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.294058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.294058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.295730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.346254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.348023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.366256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a89beb-3988-4872-a45f-e7ee0b226560 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.376044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.379223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1020/2004] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:26 2021] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:26.379345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.379345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.379345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] PATH_INFO: `/v3/projects/3d54b590e2c04454aaedc3b4b342eb67` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.379345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d54b590e2c04454aaedc3b4b342eb67)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.380311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.380599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.441146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cdd25-86e4-44bd-9275-e776188f6c42 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.446384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.447053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.447344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.447626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.448317 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.450258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.513942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d54b590e2c04454aaedc3b4b342eb67', 'request_id': 'req-aa0b36aa-1f26-45d4-972f-0f918caec45b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.519808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d54b590e2c04454aaedc3b4b342eb67', 'request_id': 'req-aa0b36aa-1f26-45d4-972f-0f918caec45b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.527492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d54b590e2c04454aaedc3b4b342eb67', 'request_id': 'req-aa0b36aa-1f26-45d4-972f-0f918caec45b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.533172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1021/2005] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:26 2021] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:26.537105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.546435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596ebc6-221e-4012-aa0b-6eb4bb5bf1c3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.602840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.603535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.603823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.604099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.605185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.606755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.620331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1022/2006] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:26 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:26:26.621511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.623646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] The token cache is being invalidate because project 3d54b590e2c04454aaedc3b4b342eb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:26.624145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.624690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.627127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 985/2007] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:26 2021] DELETE /identity/v3/projects/3d54b590e2c04454aaedc3b4b342eb67 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:26.630153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.631494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.634968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f6001-009e-41cb-a099-d50f309e2179 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.642329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.642329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.642329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.642329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.642666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.643522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.650011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b36aa-1f26-45d4-972f-0f918caec45b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.656830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1023/2008] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:26 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:26.656976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.656976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.656976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.656976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] PATH_INFO: `/v3/users/38f1db2d7fba4a70819cafbcad610df8` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.657570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f1db2d7fba4a70819cafbcad610df8)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.658404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.659491 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.660167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.672327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2571c-1566-4c76-b2ad-6693497d9143 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.677204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc040dc-5fc5-4862-9bef-a7f5e9fa3642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.678127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc040dc-5fc5-4862-9bef-a7f5e9fa3642 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.678398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc040dc-5fc5-4862-9bef-a7f5e9fa3642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.678680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc040dc-5fc5-4862-9bef-a7f5e9fa3642 admin admin] PATH_INFO: `/v3/projects/a65f459abc4844db84a3651943fd5d10/users/13e4646c59424699a21e48885e4dfd0f/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.694565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc040dc-5fc5-4862-9bef-a7f5e9fa3642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65f459abc4844db84a3651943fd5d10, user_id=13e4646c59424699a21e48885e4dfd0f, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.697962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc040dc-5fc5-4862-9bef-a7f5e9fa3642 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:26.791046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1024/2009] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:26 2021] PUT /identity/v3/projects/a65f459abc4844db84a3651943fd5d10/users/13e4646c59424699a21e48885e4dfd0f/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:26.801063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.801355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.801639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.827770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] MFA Rules not processed for user `13e4646c59424699a21e48885e4dfd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:26.829011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.878526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f1db2d7fba4a70819cafbcad610df8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.879139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f1db2d7fba4a70819cafbcad610df8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.879756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f1db2d7fba4a70819cafbcad610df8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.890899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1025/2010] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:26 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:26.901295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:26.902632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.950782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f1db2d7fba4a70819cafbcad610df8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.963861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664c495-02bc-4909-a5aa-3a1115c6a350 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:26.965898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f1db2d7fba4a70819cafbcad610df8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:26.969340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:26.970571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:26.970986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:26.972104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:26.974521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:26.987396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 986/2011] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:26 2021] DELETE /identity/v3/users/38f1db2d7fba4a70819cafbcad610df8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:26.995216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:26.995216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:27.004143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1026/2012] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:26 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:27.465846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:27.467247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:27.512984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:27.512984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:27.565353 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8277-a53a-4e12-9445-21904ebb6993 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:27.578086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:27.583064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:27.583064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:27.583064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] PATH_INFO: `/v3/projects/7793c426b4ec491db1b327eb675c3086` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:27.584364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7793c426b4ec491db1b327eb675c3086)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:27.587068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:27.610586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84f348-81a0-4f24-b589-76384ca43dc2 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:27.615283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:27.616153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:27.616473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:27.616757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] PATH_INFO: `/v3/users/b4f9ea15b91d470b953c6630e5e2c647` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:27.617987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f9ea15b91d470b953c6630e5e2c647)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:27.619896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:27.727847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7793c426b4ec491db1b327eb675c3086', 'request_id': 'req-59c653ed-f5e4-4d34-980a-a8e1aea1355f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.737092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7793c426b4ec491db1b327eb675c3086', 'request_id': 'req-59c653ed-f5e4-4d34-980a-a8e1aea1355f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.743822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7793c426b4ec491db1b327eb675c3086', 'request_id': 'req-59c653ed-f5e4-4d34-980a-a8e1aea1355f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.826566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f9ea15b91d470b953c6630e5e2c647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.832454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] The token cache is being invalidate because project 7793c426b4ec491db1b327eb675c3086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:27.832768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.833436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-59c653ed-f5e4-4d34-980a-a8e1aea1355f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.835117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 987/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:27 2021] DELETE /identity/v3/projects/7793c426b4ec491db1b327eb675c3086 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:27.841269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58804e0-428c-4205-8b07-5ee828d8f6cd None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:27.841560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58804e0-428c-4205-8b07-5ee828d8f6cd None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:27.841841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58804e0-428c-4205-8b07-5ee828d8f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:27.859738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a58804e0-428c-4205-8b07-5ee828d8f6cd None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:27.860956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a58804e0-428c-4205-8b07-5ee828d8f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:27.887826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f9ea15b91d470b953c6630e5e2c647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.903885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f9ea15b91d470b953c6630e5e2c647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.911769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f9ea15b91d470b953c6630e5e2c647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.912527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9c8ae1e8-e41a-49e1-ac78-142eee0c5d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f9ea15b91d470b953c6630e5e2c647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:27.918646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1027/2014] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:26:27 2021] DELETE /identity/v3/users/b4f9ea15b91d470b953c6630e5e2c647 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:27.923117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 988/2015] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:27.923254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:27.923617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:27.923963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:27.931670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:27.932006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:27.932304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:27.940909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:27.942163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:27.950918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:27.952333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:27.998783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1028/2016] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:28.009087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.010077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 989/2017] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:28.010541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:28.013972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.022366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d617-f4fd-42ba-aa8b-368656c97233 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.027372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.028003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.028285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.028602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.029379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:26:28.029688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.031352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.042965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 990/2018] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:26:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:26:28.047134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.056368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c99e3-5966-4766-aad6-3a823a925d82 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.061100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.061741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.062022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.062297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.063024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.064993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.068386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba6c74-332f-45ee-b710-d2fd8736a1a1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.072596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.073243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.073531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.073816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.083167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.086806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.094558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1029/2019] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:26:28.149895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 991/2020] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:28 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:26:28.154120 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.163774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f19be-4bf1-42ab-bba8-27cff49f8a75 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.221740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.222413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.222698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.222976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.223710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.225854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.319698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1030/2021] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:28 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:28.324215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.334583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07257d-d0ba-4ac8-81b3-a2aace03b8f2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.339474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.340147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.340469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.340754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.341485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.343133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.353142 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 992/2022] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:28.357267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.366908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb156-b060-4a2f-961c-42d255b76b44 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.372357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.373042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.373327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.373601 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.374315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.375887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.387210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1031/2023] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:28.391659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.402404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fd87-c810-4a7c-acb4-a1d7c51047a0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.407430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca0fe-b806-4901-813a-c6ce7debfcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.413735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca0fe-b806-4901-813a-c6ce7debfcff admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.413735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca0fe-b806-4901-813a-c6ce7debfcff admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.413735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca0fe-b806-4901-813a-c6ce7debfcff admin admin] PATH_INFO: `/v3/projects/64e08953a4c24caca114a0646b7ef4b1/users/4e972410101945caa44ce5ceac4b0c14/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.423093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca0fe-b806-4901-813a-c6ce7debfcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e08953a4c24caca114a0646b7ef4b1, user_id=4e972410101945caa44ce5ceac4b0c14, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.425868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ca0fe-b806-4901-813a-c6ce7debfcff admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.540364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 993/2024] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:28 2021] PUT /identity/v3/projects/64e08953a4c24caca114a0646b7ef4b1/users/4e972410101945caa44ce5ceac4b0c14/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:28.541935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.543819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:28.550993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.551378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.551563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.560396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a806c-9058-4b3b-8b16-d8a787e4d811 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.591792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] MFA Rules not processed for user `4e972410101945caa44ce5ceac4b0c14`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:28.592284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:28.642166 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.643297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.643684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.644111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] PATH_INFO: `/v3/projects/a744ae79ea894c46b13ac674ff005b59` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.645464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a744ae79ea894c46b13ac674ff005b59)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.647738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.670989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 994/2025] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:28 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:26:28.672491 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.683965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e718-fc3c-434d-8b18-d8ba6dafaf27 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.688558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.689221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.689512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.689791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.690575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.692463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.806462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 995/2026] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:26:28 2021] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:28.808384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:28.833201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a744ae79ea894c46b13ac674ff005b59', 'request_id': 'req-fe640d7b-a246-4b74-8011-7206af52deb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:28.839589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a744ae79ea894c46b13ac674ff005b59', 'request_id': 'req-fe640d7b-a246-4b74-8011-7206af52deb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:28.856388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a744ae79ea894c46b13ac674ff005b59', 'request_id': 'req-fe640d7b-a246-4b74-8011-7206af52deb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:28.908265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794033a-71fc-4e47-93da-7158d2a96ee6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:28.913000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:28.913720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:28.914002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:28.914930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:28.915619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:28.917565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:28.925709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] The token cache is being invalidate because project a744ae79ea894c46b13ac674ff005b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:26:28.925887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:28.926618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:26:28.928436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1032/2027] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:26:28 2021] DELETE /identity/v3/projects/a744ae79ea894c46b13ac674ff005b59 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:29.019936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 996/2028] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:26:28 2021] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:26:29.028081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:29.029755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:29.116875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640d7b-a246-4b74-8011-7206af52deb4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:29.122431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:29.124257 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:29.124576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:29.124859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:29.126081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:29.127738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:29.139043 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1033/2029] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:29 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:29.143371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:29.153919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63319e18-316c-413c-9175-0ef200125f2b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:29.158796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:29.159816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:29.160101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:29.160575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] PATH_INFO: `/v3/projects/8a21fc34880e4d90a544c83b639fae50/users/2d2ebc89cb354a1abd6112b0aba805a1/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:29.177866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a21fc34880e4d90a544c83b639fae50, user_id=2d2ebc89cb354a1abd6112b0aba805a1, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:29.181103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:29.256892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 997/2030] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:29 2021] PUT /identity/v3/projects/8a21fc34880e4d90a544c83b639fae50/users/2d2ebc89cb354a1abd6112b0aba805a1/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:26:29.258485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:29.268643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1673-0016-4c11-86eb-a498f2891abc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:29.326619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033f79-e808-4152-b73e-5f66c77734f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:29.327299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033f79-e808-4152-b73e-5f66c77734f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:29.327582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033f79-e808-4152-b73e-5f66c77734f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:29.327861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033f79-e808-4152-b73e-5f66c77734f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:29.328620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea033f79-e808-4152-b73e-5f66c77734f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:29.330231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea033f79-e808-4152-b73e-5f66c77734f8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:29.343355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1034/2031] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:26:29 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:26:29.346577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:29.360706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132ba42-6c97-48cb-b501-2709b3764c3e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:29.368231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:29.369158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:29.369457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:29.371830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] PATH_INFO: `/v3/projects/8a21fc34880e4d90a544c83b639fae50/users/2d2ebc89cb354a1abd6112b0aba805a1/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:29.371830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a21fc34880e4d90a544c83b639fae50, user_id=2d2ebc89cb354a1abd6112b0aba805a1, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:29.374418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:29.385238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 998/2032] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:26:29 2021] PUT /identity/v3/projects/8a21fc34880e4d90a544c83b639fae50/users/2d2ebc89cb354a1abd6112b0aba805a1/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:26:29.395486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:29.395777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:29.396057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:29.421959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] MFA Rules not processed for user `2d2ebc89cb354a1abd6112b0aba805a1`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:29.423139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:29.498222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1035/2033] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:29 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:26:29.507960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:29.509671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:29.564518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a23a4-5594-4018-9f0e-d6f01113aa79 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:29.568407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:29.569098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:29.569389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:29.569672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:29.571512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:29.631164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:29.632612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5380c-4c7a-4707-8d86-b34c94f94d24 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:29.641426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 999/2034] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:29 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:35.921202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:26:35.934673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb748a0-2503-4c9a-9efe-56d7b7727041 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:26:35.939647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:26:35.940352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:35.940819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:35.941242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:35.955360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:26:35.957001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:26:35.967408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1036/2035] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:26:35 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:26:41.379303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303531-b27b-4669-a452-25bf8caa9a69 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:26:41.381075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303531-b27b-4669-a452-25bf8caa9a69 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:26:41.381457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303531-b27b-4669-a452-25bf8caa9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:26:41.409381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-38303531-b27b-4669-a452-25bf8caa9a69 None None] MFA Rules not processed for user `19410737ca1d477b8e5258d11f2ed33e`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:26:41.411067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-38303531-b27b-4669-a452-25bf8caa9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:26:41.465279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1000/2036] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:26:41 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:03.681478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:03.684954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:03.750174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb8ed-ee17-4166-9537-f44ee35b1d55 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:03.754694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:03.759258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:03.759258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:03.759258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] PATH_INFO: `/v3/users/ff63fcb91670483392e4db4ec3982cd9` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:03.759258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff63fcb91670483392e4db4ec3982cd9)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:03.759258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:03.986773 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff63fcb91670483392e4db4ec3982cd9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.069381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff63fcb91670483392e4db4ec3982cd9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.090152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff63fcb91670483392e4db4ec3982cd9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.098059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff63fcb91670483392e4db4ec3982cd9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.098791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff63fcb91670483392e4db4ec3982cd9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.105135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1037/2037] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:03 2021] DELETE /identity/v3/users/ff63fcb91670483392e4db4ec3982cd9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:04.110341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:04.110811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:04.110935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:04.130209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:04.131411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:04.187278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1001/2038] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:04.197125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:04.198509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:04.270366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a45e9-1cfe-47c3-8100-efb907bd1756 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:04.274050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d96cef-ce05-46ce-9e6b-5e214bfd361e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:04.274701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d96cef-ce05-46ce-9e6b-5e214bfd361e service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:04.274984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d96cef-ce05-46ce-9e6b-5e214bfd361e service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:04.275259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d96cef-ce05-46ce-9e6b-5e214bfd361e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:04.285081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d96cef-ce05-46ce-9e6b-5e214bfd361e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:04.286568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d96cef-ce05-46ce-9e6b-5e214bfd361e service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:04.297226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1038/2039] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:27:04.717463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:04.719029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:04.731802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86079546-1a82-443b-be20-5ef119d46f44 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:04.736570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:04.737434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:04.737775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:04.738059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] PATH_INFO: `/v3/projects/4ae5d34c45194215b2c317fed2da0a8a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:04.739887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae5d34c45194215b2c317fed2da0a8a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:04.741858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:04.859376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae5d34c45194215b2c317fed2da0a8a', 'request_id': 'req-2c4436d5-91e8-4449-b87f-ff966732b7b2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.864974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae5d34c45194215b2c317fed2da0a8a', 'request_id': 'req-2c4436d5-91e8-4449-b87f-ff966732b7b2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.871656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae5d34c45194215b2c317fed2da0a8a', 'request_id': 'req-2c4436d5-91e8-4449-b87f-ff966732b7b2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.935046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] The token cache is being invalidate because project 4ae5d34c45194215b2c317fed2da0a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:04.935337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.936045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2c4436d5-91e8-4449-b87f-ff966732b7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:04.937683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1002/2040] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:04 2021] DELETE /identity/v3/projects/4ae5d34c45194215b2c317fed2da0a8a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:04.943472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:04.947583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:04.947583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:04.961243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:04.962423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:05.018749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1039/2041] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:05.026339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.026630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.026909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.045891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:05.047081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:05.058341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1003/2042] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:05.062553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.077271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2526f-70e6-4dbe-b3d5-21df84dbb152 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.079791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.080490 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.080780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.081065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.081790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:27:05.082101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.083713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.099322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1040/2043] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:27:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:27:05.100405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.109885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e6252-4306-47dc-bc50-7ee732a3d348 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.118569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.118569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.118569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.118569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.119370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.120872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.231615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1004/2044] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:05 2021] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:05.238069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.252728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0f9b-6540-4649-a2ce-d5f9cd8a9988 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.308169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.308868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.309179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.309454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.310135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.312037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.415619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1041/2045] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:05 2021] POST /identity/v3/users => generated 280 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:05.417127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.431726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8d3e-8d11-4d06-9d29-21ea2b1555fc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.439062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.440058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.440520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.440944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.442059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.444635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.457874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1005/2046] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:05 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:05.462402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.473024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720cb1e-c7ae-4470-b5ce-e1b1691d83bb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.478338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a8fa0-b2eb-4aa0-a7d8-6bfc4e51ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.479013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a8fa0-b2eb-4aa0-a7d8-6bfc4e51ef0a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.479307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a8fa0-b2eb-4aa0-a7d8-6bfc4e51ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.479595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a8fa0-b2eb-4aa0-a7d8-6bfc4e51ef0a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.480616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a8fa0-b2eb-4aa0-a7d8-6bfc4e51ef0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.482270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a8fa0-b2eb-4aa0-a7d8-6bfc4e51ef0a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.492293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1042/2047] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:05.497104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.507462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd84fa9-1acf-4ce4-b025-a8f70e6513f7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.512979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.513882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.514173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.514457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] PATH_INFO: `/v3/projects/4454897a7e2a4783aca3feece75cbf5a/users/b2d37ed2a30543969e893bb6e0a5fed0/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.529818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4454897a7e2a4783aca3feece75cbf5a, user_id=b2d37ed2a30543969e893bb6e0a5fed0, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.531912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.635504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1006/2048] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:05 2021] PUT /identity/v3/projects/4454897a7e2a4783aca3feece75cbf5a/users/b2d37ed2a30543969e893bb6e0a5fed0/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:05.648492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.648815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.649102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.677242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] MFA Rules not processed for user `b2d37ed2a30543969e893bb6e0a5fed0`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:05.678427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:05.747942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1043/2049] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:05 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:05.775665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.777508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:05.834822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c9660-05e8-463e-82e3-bbe70b53d9e3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.838705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ad85-fa53-4ac5-9dd3-043cf20da667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.839269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ad85-fa53-4ac5-9dd3-043cf20da667 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.839642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ad85-fa53-4ac5-9dd3-043cf20da667 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.839917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ad85-fa53-4ac5-9dd3-043cf20da667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.848693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ad85-fa53-4ac5-9dd3-043cf20da667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.850108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ad85-fa53-4ac5-9dd3-043cf20da667 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:05.859677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1007/2050] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:05 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:05.873833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:05.933379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da12af-420e-42ec-addd-d31c0b522843 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:05.938740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:05.939594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:05.940304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:05.940304 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] PATH_INFO: `/v3/users/b2d37ed2a30543969e893bb6e0a5fed0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:05.941382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d37ed2a30543969e893bb6e0a5fed0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:05.943334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:06.143089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d37ed2a30543969e893bb6e0a5fed0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:06.233209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d37ed2a30543969e893bb6e0a5fed0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:06.246104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d37ed2a30543969e893bb6e0a5fed0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:06.259155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d37ed2a30543969e893bb6e0a5fed0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:06.259155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d37ed2a30543969e893bb6e0a5fed0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:06.259804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1044/2051] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:05 2021] DELETE /identity/v3/users/b2d37ed2a30543969e893bb6e0a5fed0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:06.264202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:06.264712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:06.264937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:06.283575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:06.284745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:06.346038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1008/2052] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:27:06.356635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:06.358036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:06.436953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a643d7-ccd1-434c-a62c-1a171f72da8d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:06.440787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd26e2-30ee-405b-b2c8-11a484b1ac1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:06.441547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd26e2-30ee-405b-b2c8-11a484b1ac1c service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:06.441834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd26e2-30ee-405b-b2c8-11a484b1ac1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:06.442109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd26e2-30ee-405b-b2c8-11a484b1ac1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:06.451516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd26e2-30ee-405b-b2c8-11a484b1ac1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:06.452981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd26e2-30ee-405b-b2c8-11a484b1ac1c service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:06.462477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1045/2053] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:06.905787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:06.907181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:06.918983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7023e0-8a2f-4e4f-bfff-f017a0d12dac None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:06.924203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:06.925184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:06.925466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:06.925745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] PATH_INFO: `/v3/projects/4454897a7e2a4783aca3feece75cbf5a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:06.927045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4454897a7e2a4783aca3feece75cbf5a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:06.929151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.058149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4454897a7e2a4783aca3feece75cbf5a', 'request_id': 'req-fa528372-121a-4e08-8f02-2fb5833fa23e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:07.065131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4454897a7e2a4783aca3feece75cbf5a', 'request_id': 'req-fa528372-121a-4e08-8f02-2fb5833fa23e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:07.075802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4454897a7e2a4783aca3feece75cbf5a', 'request_id': 'req-fa528372-121a-4e08-8f02-2fb5833fa23e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:07.169474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] The token cache is being invalidate because project 4454897a7e2a4783aca3feece75cbf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:07.169766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:07.170847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fa528372-121a-4e08-8f02-2fb5833fa23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:07.172122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1009/2054] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:06 2021] DELETE /identity/v3/projects/4454897a7e2a4783aca3feece75cbf5a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:07.177955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.178423 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.178512 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.196126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:07.197349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:07.284916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1046/2055] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:27:07.293126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.294153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.294262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.314644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:07.318701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:07.323610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1010/2056] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:07.327988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.337674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e15a6-76ec-463f-b4a0-9d0df9bbea73 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:07.342435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:07.343097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.343381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.343654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.344381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:27:07.344728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:07.346323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.358936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1047/2057] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:27:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:27:07.367765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.380097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c29a-36dc-4f37-971f-fd08449b02ae None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:07.385978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:07.386808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.387131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.387409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.388262 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:07.390067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.498235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1011/2058] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:07 2021] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:07.498383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.506146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeab82-7fdd-4cf2-9680-e5c49af26c3b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:07.564314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:07.565026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.565402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.565701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.566467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:07.568378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.658403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1048/2059] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:07 2021] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:07.659711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.670324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f24c-61d7-46ab-ba8b-b566f2749cde admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:07.675225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:07.675899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.676236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.676516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.677251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:07.678838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.690216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1012/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:07.694268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.704344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab14c3-81dc-41d5-86fb-78bb50db2e40 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:07.709155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee172d-dc99-42da-a10f-1a17bbeb641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:07.709826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee172d-dc99-42da-a10f-1a17bbeb641e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.710127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee172d-dc99-42da-a10f-1a17bbeb641e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.710395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee172d-dc99-42da-a10f-1a17bbeb641e admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.711135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee172d-dc99-42da-a10f-1a17bbeb641e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:07.712745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee172d-dc99-42da-a10f-1a17bbeb641e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.723112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1049/2061] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:07.727819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.738475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2595-4855-479d-a38c-88ef9cf10814 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:07.743242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:07.744122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.744404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.744723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] PATH_INFO: `/v3/projects/6006776d6ecf45f19d9f1d2bf1393fd1/users/fc19c67683ff49b9b0d7fbeee014a6ad/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.759385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6006776d6ecf45f19d9f1d2bf1393fd1, user_id=fc19c67683ff49b9b0d7fbeee014a6ad, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:07.762153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:07.869445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1013/2062] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:07 2021] PUT /identity/v3/projects/6006776d6ecf45f19d9f1d2bf1393fd1/users/fc19c67683ff49b9b0d7fbeee014a6ad/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:07.879569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:07.879868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:07.880156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:07.906061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] MFA Rules not processed for user `fc19c67683ff49b9b0d7fbeee014a6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:07.907245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:07.971057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1050/2063] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:07 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:07.982411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:07.984072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:08.038736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6dd7-f104-4ee5-aa84-b2d4ca2e79cb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:08.042412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ada863-3945-48e2-b4b4-78f68730f429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:08.043066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada863-3945-48e2-b4b4-78f68730f429 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:08.043439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada863-3945-48e2-b4b4-78f68730f429 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:08.043709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada863-3945-48e2-b4b4-78f68730f429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:08.051788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ada863-3945-48e2-b4b4-78f68730f429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:08.053296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ada863-3945-48e2-b4b4-78f68730f429 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:08.061871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1014/2064] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:07 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:08.503302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:08.504831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:08.572096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638feb-4e36-4b3b-bcb6-dde54cf64aea None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:08.577327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:08.578199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:08.578487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:08.578765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] PATH_INFO: `/v3/users/4e972410101945caa44ce5ceac4b0c14` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:08.579947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e972410101945caa44ce5ceac4b0c14)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:08.582007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:08.810224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e972410101945caa44ce5ceac4b0c14'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:08.886656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e972410101945caa44ce5ceac4b0c14'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:08.905411 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e972410101945caa44ce5ceac4b0c14'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:08.912412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e972410101945caa44ce5ceac4b0c14'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:08.913184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e972410101945caa44ce5ceac4b0c14'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:08.919533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1051/2065] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:08 2021] DELETE /identity/v3/users/4e972410101945caa44ce5ceac4b0c14 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:08.923978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:08.924479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:08.924592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:08.942725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:08.943926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:09.000776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1015/2066] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:09.010675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:09.012119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:09.068451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cbccd-61b3-4005-aabe-f79422e63517 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:09.072029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:09.072709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:09.073002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:09.073286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:09.082138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:09.083552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:09.093053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1052/2067] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:27:09.553518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:09.555975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:09.583203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14863213-6b6a-4d77-96d7-1a6a98f3dd8c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:09.590211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:09.593451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:09.593451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:09.593451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] PATH_INFO: `/v3/projects/64e08953a4c24caca114a0646b7ef4b1` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:09.593749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e08953a4c24caca114a0646b7ef4b1)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:09.595445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:09.747005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e08953a4c24caca114a0646b7ef4b1', 'request_id': 'req-2efeef71-eb47-490b-bed0-a3764818869f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:09.752254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e08953a4c24caca114a0646b7ef4b1', 'request_id': 'req-2efeef71-eb47-490b-bed0-a3764818869f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:09.758402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e08953a4c24caca114a0646b7ef4b1', 'request_id': 'req-2efeef71-eb47-490b-bed0-a3764818869f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:09.834220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] The token cache is being invalidate because project 64e08953a4c24caca114a0646b7ef4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:09.834509 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:09.835151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:09.839774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1016/2068] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:09 2021] DELETE /identity/v3/projects/64e08953a4c24caca114a0646b7ef4b1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:09.841779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:09.852316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47425d-7b73-418a-8f15-9897fefa074e service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:09.910824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:09.912003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:09.912003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:09.912271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] PATH_INFO: `/v3/users/2d2ebc89cb354a1abd6112b0aba805a1` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:09.913776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2ebc89cb354a1abd6112b0aba805a1)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:09.915477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:10.108402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2ebc89cb354a1abd6112b0aba805a1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.158620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2ebc89cb354a1abd6112b0aba805a1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.171443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2ebc89cb354a1abd6112b0aba805a1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.178230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2ebc89cb354a1abd6112b0aba805a1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.178948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a24a8d0a-beb1-48eb-b473-8e63836d0f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2ebc89cb354a1abd6112b0aba805a1'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.185313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1053/2069] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:09 2021] DELETE /identity/v3/users/2d2ebc89cb354a1abd6112b0aba805a1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:10.721979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:10.723479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:10.738367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeef71-eb47-490b-bed0-a3764818869f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:10.795418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:10.796232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:10.796674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:10.796966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] PATH_INFO: `/v3/projects/8a21fc34880e4d90a544c83b639fae50` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:10.798189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a21fc34880e4d90a544c83b639fae50)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:10.800102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:10.943340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a21fc34880e4d90a544c83b639fae50', 'request_id': 'req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.948662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a21fc34880e4d90a544c83b639fae50', 'request_id': 'req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:10.955301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a21fc34880e4d90a544c83b639fae50', 'request_id': 'req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:11.033418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] The token cache is being invalidate because project 8a21fc34880e4d90a544c83b639fae50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:11.033705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:11.034313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-bd9ac26c-f736-42cc-ae3f-f1c77d443cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:11.035857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1017/2070] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:10 2021] DELETE /identity/v3/projects/8a21fc34880e4d90a544c83b639fae50 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:11.043824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.044378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.044574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.064241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:11.065412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:11.241614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1054/2071] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:11.250070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857172d5-5535-4e51-a789-341d511f96ba None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.250365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857172d5-5535-4e51-a789-341d511f96ba None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.250647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857172d5-5535-4e51-a789-341d511f96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.269097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-857172d5-5535-4e51-a789-341d511f96ba None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:11.270269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-857172d5-5535-4e51-a789-341d511f96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:11.277992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1018/2072] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:27:11.282090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.291455 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5748-31bb-4212-9c90-ed2e379d8c94 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.296625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.297277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.297563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.297842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.298565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:27:11.298875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.300489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:11.312776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1055/2073] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:27:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:27:11.317107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857172d5-5535-4e51-a789-341d511f96ba None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.326076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857172d5-5535-4e51-a789-341d511f96ba None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.330815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.331471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.331750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.332026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.332764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.334701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:11.409828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1019/2074] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:11 2021] POST /identity/v3/projects => generated 407 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:11.414044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.424531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48e73-3213-426c-b0fa-cf9a8ca8ee92 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.478013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.478676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.478963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.479278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.480225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.482789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:11.635798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1056/2075] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:11 2021] POST /identity/v3/users => generated 304 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:11.639722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.649865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf1d82-34d7-49ac-99ce-67cfab6a9db7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.655123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.655780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.656063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.656335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.657122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.658718 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:11.671602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1020/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:11.673566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.683448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178004c4-138e-4e48-a8ca-2915cc72b5b8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.688113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed594dbc-500e-4a56-a2b6-ea1ccc0e29e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.688801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed594dbc-500e-4a56-a2b6-ea1ccc0e29e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.689123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed594dbc-500e-4a56-a2b6-ea1ccc0e29e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.689412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed594dbc-500e-4a56-a2b6-ea1ccc0e29e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.690190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed594dbc-500e-4a56-a2b6-ea1ccc0e29e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.691835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed594dbc-500e-4a56-a2b6-ea1ccc0e29e7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:11.702086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1057/2077] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:11.706398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.717077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338cff1-070c-4cf2-bb5f-df7af1ed0ff9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.721648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.722529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.723060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.723159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] PATH_INFO: `/v3/projects/ee5c57592cae44be8f72d203f501819f/users/30a359bc317e43ba88c8c6ceda4b6016/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.738230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5c57592cae44be8f72d203f501819f, user_id=30a359bc317e43ba88c8c6ceda4b6016, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.741058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:11.821642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1021/2078] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:11 2021] PUT /identity/v3/projects/ee5c57592cae44be8f72d203f501819f/users/30a359bc317e43ba88c8c6ceda4b6016/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:11.832177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.832565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.837417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.859540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] MFA Rules not processed for user `30a359bc317e43ba88c8c6ceda4b6016`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:11.860755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:11.921540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1058/2079] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:11 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:11.925907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:11.984006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f3957-2532-41c1-b4c0-a646ae509847 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:11.988603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:11.989259 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:11.989545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:11.989824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:11.990511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:11.992388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.061118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1022/2080] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:11 2021] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:12.065247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:12.076169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f71d-cb90-42da-a92b-5491aeb05dc9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:12.128897 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:12.129487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.129771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.130049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.130738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:12.132644 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.249755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1059/2081] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:12 2021] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:12.253749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:12.264567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7fd01-deeb-4497-97cf-3f0e5d6769f3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:12.269139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:12.269798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.270080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.270354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.271067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:12.272673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.283475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1023/2082] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:12.287426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:12.297088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b87ab-c74c-4cd6-a8df-5479f08471f3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:12.301774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:12.302643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.302923 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.303197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] PATH_INFO: `/v3/projects/d5d4d3d9075046009c0038e317eaadc6/users/41912b376d5044a78d9fb3fc42074dd8/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.317289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d4d3d9075046009c0038e317eaadc6, user_id=41912b376d5044a78d9fb3fc42074dd8, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:12.319902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.420810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1060/2083] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:12 2021] PUT /identity/v3/projects/d5d4d3d9075046009c0038e317eaadc6/users/41912b376d5044a78d9fb3fc42074dd8/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:12.424688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:12.434431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd299d3-c69a-4cd5-8cb9-977990444956 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:12.487641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdadbb-5cce-4acd-b553-d80820d7f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:12.488319 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdadbb-5cce-4acd-b553-d80820d7f7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.488658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdadbb-5cce-4acd-b553-d80820d7f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.488939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdadbb-5cce-4acd-b553-d80820d7f7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.489679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdadbb-5cce-4acd-b553-d80820d7f7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:12.491307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdadbb-5cce-4acd-b553-d80820d7f7d1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.500720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1024/2084] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:12 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:27:12.504936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:12.515417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d5b67-0207-4718-bd47-0c130066488c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:12.520005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:12.520911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.521195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.521470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] PATH_INFO: `/v3/projects/d5d4d3d9075046009c0038e317eaadc6/users/41912b376d5044a78d9fb3fc42074dd8/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.523502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d4d3d9075046009c0038e317eaadc6, user_id=41912b376d5044a78d9fb3fc42074dd8, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:12.526119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.536596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1061/2085] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:12 2021] PUT /identity/v3/projects/d5d4d3d9075046009c0038e317eaadc6/users/41912b376d5044a78d9fb3fc42074dd8/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:12.547149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.547447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.547730 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.573130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] MFA Rules not processed for user `41912b376d5044a78d9fb3fc42074dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:12.574357 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:12.640795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1025/2086] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:12 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:12.650456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:12.652119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:12.705850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d95a5-4c30-4817-ad30-37a438e1acaf admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:12.709570 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:12.710206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:12.710494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:12.710771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:12.719650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:12.721093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:12.731328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1062/2087] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:12 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:13.086230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:13.095897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60563183-a318-4782-8a5e-53a2d7cf1bd6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:13.099516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66c37-e325-4763-978f-381af6070ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:13.100150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66c37-e325-4763-978f-381af6070ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:13.100460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66c37-e325-4763-978f-381af6070ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:13.100748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66c37-e325-4763-978f-381af6070ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:13.155333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66c37-e325-4763-978f-381af6070ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:13.156790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66c37-e325-4763-978f-381af6070ac0 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:13.165563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1026/2088] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:13 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:27:27.415799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:27.476097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecda7f-24f6-4d1c-bca8-c4915bfde787 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:27.480962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:27.481818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:27.482106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:27.482382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] PATH_INFO: `/v3/users/30a359bc317e43ba88c8c6ceda4b6016` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:27.483560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a359bc317e43ba88c8c6ceda4b6016)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:27.485502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:27.690746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a359bc317e43ba88c8c6ceda4b6016'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:27.765853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a359bc317e43ba88c8c6ceda4b6016'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:27.778640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a359bc317e43ba88c8c6ceda4b6016'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:27.785464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a359bc317e43ba88c8c6ceda4b6016'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:27.795202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a359bc317e43ba88c8c6ceda4b6016'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:27.795202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1063/2089] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:27 2021] DELETE /identity/v3/users/30a359bc317e43ba88c8c6ceda4b6016 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:27.798421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:27.798907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:27.799005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:27.816275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:27.817485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:27.873122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1027/2090] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:27.883310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:27.884723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:27.938285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8888c-3ce0-40ee-90da-e3ee43a108f4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:27.941870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:27.942506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:27.942789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:27.943064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:27.952343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:27.953762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:27.962851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1064/2091] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:28.648223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:28.649690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:28.661149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341eb8f-072d-4ace-9683-434c4f30d9d1 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:28.667386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:28.668540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:28.668688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:28.668991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] PATH_INFO: `/v3/projects/ee5c57592cae44be8f72d203f501819f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:28.670179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5c57592cae44be8f72d203f501819f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:28.672890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:28.837978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5c57592cae44be8f72d203f501819f', 'request_id': 'req-16e58cd8-7c28-4fca-9403-af8e8b277e35'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:28.843320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5c57592cae44be8f72d203f501819f', 'request_id': 'req-16e58cd8-7c28-4fca-9403-af8e8b277e35'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:28.849672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5c57592cae44be8f72d203f501819f', 'request_id': 'req-16e58cd8-7c28-4fca-9403-af8e8b277e35'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:28.942237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] The token cache is being invalidate because project ee5c57592cae44be8f72d203f501819f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:28.942591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:28.943215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:28.945544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1028/2092] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:28 2021] DELETE /identity/v3/projects/ee5c57592cae44be8f72d203f501819f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:28.949971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:28.960028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb06f-70bd-4c2f-ade7-05b5c81d2edd service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:29.013563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:29.014427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:29.014713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:29.014991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] PATH_INFO: `/v3/users/41912b376d5044a78d9fb3fc42074dd8` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:29.016167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41912b376d5044a78d9fb3fc42074dd8)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:29.018083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:29.257041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41912b376d5044a78d9fb3fc42074dd8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.317748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41912b376d5044a78d9fb3fc42074dd8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.330847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41912b376d5044a78d9fb3fc42074dd8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.337515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41912b376d5044a78d9fb3fc42074dd8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.338185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8de1c95a-4a2c-4b7f-b0b2-8bf2f3cc7264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41912b376d5044a78d9fb3fc42074dd8'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.343886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1065/2093] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:28 2021] DELETE /identity/v3/users/41912b376d5044a78d9fb3fc42074dd8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:29.758751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:29.760197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:29.774994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e58cd8-7c28-4fca-9403-af8e8b277e35 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:29.830450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:29.831284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:29.831567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:29.831841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] PATH_INFO: `/v3/projects/d5d4d3d9075046009c0038e317eaadc6` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:29.833039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d4d3d9075046009c0038e317eaadc6)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:29.834929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:29.967245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d4d3d9075046009c0038e317eaadc6', 'request_id': 'req-10ae107a-af3a-403b-b294-5dee5653edea'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.972948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d4d3d9075046009c0038e317eaadc6', 'request_id': 'req-10ae107a-af3a-403b-b294-5dee5653edea'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:29.979939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d4d3d9075046009c0038e317eaadc6', 'request_id': 'req-10ae107a-af3a-403b-b294-5dee5653edea'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:30.073754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] The token cache is being invalidate because project d5d4d3d9075046009c0038e317eaadc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:30.074046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:30.074659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-10ae107a-af3a-403b-b294-5dee5653edea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:30.076272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1029/2094] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:29 2021] DELETE /identity/v3/projects/d5d4d3d9075046009c0038e317eaadc6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:30.081902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.082416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.082543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.100860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:30.102048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:30.157073 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1066/2095] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:27:30.165556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.165842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.166123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.183927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:30.185171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:30.193068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1030/2096] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:30.197277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.208119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264ec3-0843-4594-bdb6-a6624db1fcf1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.211821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.212500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.212784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.213055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.213767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:27:30.214072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.215828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:30.227872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1067/2097] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:27:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:27:30.232561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.241996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8fdec-f20d-4df5-b7dc-d34c812b3e68 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.246800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.247448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.247734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.248015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.248744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.250661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:30.367003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1031/2098] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:30 2021] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:30.371572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.381997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca5079-1500-4627-83c3-d65626d4f958 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.436023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.436723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.436999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.437271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.437982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.439895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:30.557638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1068/2099] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:30 2021] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:30.561858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.573681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb35b-1ed6-4b88-b89b-3154cfa71f24 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.579039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.579713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.580000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.580304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.581071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.582696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:30.593852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1032/2100] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:30 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:27:30.602430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.607972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb18c89-1612-4ee1-bafc-5b102e3ee8d6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.613036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfca40-0255-4e3d-b620-966ab3558ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.613801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfca40-0255-4e3d-b620-966ab3558ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.614090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfca40-0255-4e3d-b620-966ab3558ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.614373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfca40-0255-4e3d-b620-966ab3558ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.615146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfca40-0255-4e3d-b620-966ab3558ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.616793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfca40-0255-4e3d-b620-966ab3558ba6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:30.626996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1069/2101] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:30.631830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.641501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d208-f5bc-4076-8cbf-dfe300b73f4f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.646160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.647640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.647922 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.648196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] PATH_INFO: `/v3/projects/78acfa237bf345e98665d9e59beeeb75/users/5178965410cc41889381fbd430d5ed31/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.662333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78acfa237bf345e98665d9e59beeeb75, user_id=5178965410cc41889381fbd430d5ed31, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.664990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:30.740981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1033/2102] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:30 2021] PUT /identity/v3/projects/78acfa237bf345e98665d9e59beeeb75/users/5178965410cc41889381fbd430d5ed31/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:30.752253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.752569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.752857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.778821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] MFA Rules not processed for user `5178965410cc41889381fbd430d5ed31`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:30.779951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:30.841424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1070/2103] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:30.850924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:30.909519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c361b-6382-4b44-ad29-bdc3542cf63a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:30.914168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:30.914816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:30.915104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:30.915385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:30.916072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:30.917987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.010946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1034/2104] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:30 2021] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:31.017446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:31.027898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a243-aded-4acc-8d46-82f55ff7111b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:31.079796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:31.080476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.080786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.081066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.081748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:31.083614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.159433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1071/2105] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:31 2021] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:31.163934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:31.174208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9b5a-92ba-4df1-888e-ac6c1f99996c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:31.179438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:31.180084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.180366 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.180671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.181388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:31.182949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.193016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1035/2106] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:31.197623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:31.206515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5671-e833-4caf-a975-3f414d0aa383 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:31.211200 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:31.212049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.212328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.212647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] PATH_INFO: `/v3/projects/9cb2c89a3d4449978d245872ed46fcdb/users/ff6ca9f79d4247278ae167cf0ea42980/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.226742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb2c89a3d4449978d245872ed46fcdb, user_id=ff6ca9f79d4247278ae167cf0ea42980, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:31.229394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.309392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1072/2107] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:31 2021] PUT /identity/v3/projects/9cb2c89a3d4449978d245872ed46fcdb/users/ff6ca9f79d4247278ae167cf0ea42980/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:31.313436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:31.323147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921199e7-6d4c-4fd5-95fc-39d832104f55 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:31.376714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dee41-ddc4-4f45-a541-c3de059e7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:31.377308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dee41-ddc4-4f45-a541-c3de059e7081 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.377596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dee41-ddc4-4f45-a541-c3de059e7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.377873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dee41-ddc4-4f45-a541-c3de059e7081 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.378584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dee41-ddc4-4f45-a541-c3de059e7081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:31.380157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dee41-ddc4-4f45-a541-c3de059e7081 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.389475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1036/2108] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:31.393499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:31.403302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b0ea-4afa-4054-8c3d-088718728552 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:31.407819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:31.408717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.408998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.409271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] PATH_INFO: `/v3/projects/9cb2c89a3d4449978d245872ed46fcdb/users/ff6ca9f79d4247278ae167cf0ea42980/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.411202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb2c89a3d4449978d245872ed46fcdb, user_id=ff6ca9f79d4247278ae167cf0ea42980, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:31.414309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.423983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1073/2109] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:31 2021] PUT /identity/v3/projects/9cb2c89a3d4449978d245872ed46fcdb/users/ff6ca9f79d4247278ae167cf0ea42980/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:31.434306 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01806686-de7c-4365-a95b-fdbe4ab5faf6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.434604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01806686-de7c-4365-a95b-fdbe4ab5faf6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.434885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01806686-de7c-4365-a95b-fdbe4ab5faf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.460019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-01806686-de7c-4365-a95b-fdbe4ab5faf6 None None] MFA Rules not processed for user `ff6ca9f79d4247278ae167cf0ea42980`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:31.461234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-01806686-de7c-4365-a95b-fdbe4ab5faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:31.525576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1037/2110] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:31 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:31.535363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:31.538006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:31.594571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d2e6-f0d1-42ab-8932-2841b4dac4ba admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:31.598616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:31.599307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:31.599632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:31.600498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:31.653866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:31.655203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:31.664629 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1074/2111] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:31 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:37.875536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:37.876002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:37.876669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:37.894681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] MFA Rules not processed for user `19410737ca1d477b8e5258d11f2ed33e`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:37.895878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:37.948607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1038/2112] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:37 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:38.091056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:38.092502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:38.103334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3855-0108-4433-b01a-9d70e6d8daa8 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:38.107385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db611-ca84-4dcc-980d-a1fdd391e12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:38.108028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db611-ca84-4dcc-980d-a1fdd391e12a service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:38.108474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db611-ca84-4dcc-980d-a1fdd391e12a service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:38.108756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db611-ca84-4dcc-980d-a1fdd391e12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:38.117719 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4db611-ca84-4dcc-980d-a1fdd391e12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:38.119118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4db611-ca84-4dcc-980d-a1fdd391e12a service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:38.128505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1075/2113] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:38 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:43.420521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:43.422011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:43.488040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452f68-2211-4178-8455-ed7f598f44eb None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:43.493243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:43.494112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:43.494394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:43.494671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] PATH_INFO: `/v3/users/fc19c67683ff49b9b0d7fbeee014a6ad` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:43.495855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc19c67683ff49b9b0d7fbeee014a6ad)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:43.497983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:43.785070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc19c67683ff49b9b0d7fbeee014a6ad'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:43.785954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc19c67683ff49b9b0d7fbeee014a6ad'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:43.786591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc19c67683ff49b9b0d7fbeee014a6ad'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:43.880291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc19c67683ff49b9b0d7fbeee014a6ad'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:43.892244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc19c67683ff49b9b0d7fbeee014a6ad'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:43.904446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1039/2114] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:43 2021] DELETE /identity/v3/users/fc19c67683ff49b9b0d7fbeee014a6ad => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:43.908881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:43.909721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:43.910163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:43.927872 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:43.929096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:43.984585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1076/2115] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:43.995118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:43.996611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.050621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f0fe3-49d7-4c35-bb5f-c2501be0e621 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:44.054929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:44.057817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.057817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.057817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.064854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:44.066259 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:44.075424 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1040/2116] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:44.312335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:44.314360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.328705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0e1b-3cca-49fb-8478-4d041a0f147b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:44.347101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:44.348366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.348821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.349798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] PATH_INFO: `/v3/users/13e4646c59424699a21e48885e4dfd0f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.351150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e4646c59424699a21e48885e4dfd0f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:44.353284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:44.550185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:44.551611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.566616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9751-f48c-420f-a099-c08059e053cd service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:44.572631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:44.573608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.573757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.574024 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] PATH_INFO: `/v3/projects/6006776d6ecf45f19d9f1d2bf1393fd1` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.575183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6006776d6ecf45f19d9f1d2bf1393fd1)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:44.577163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:44.597499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e4646c59424699a21e48885e4dfd0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.673969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e4646c59424699a21e48885e4dfd0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.686343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e4646c59424699a21e48885e4dfd0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.693844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e4646c59424699a21e48885e4dfd0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.694554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e4646c59424699a21e48885e4dfd0f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.706918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1077/2117] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:44 2021] DELETE /identity/v3/users/13e4646c59424699a21e48885e4dfd0f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:44.709115 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:44.712207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.715534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6006776d6ecf45f19d9f1d2bf1393fd1', 'request_id': 'req-eb9b8020-3e18-4375-bd0f-2fda951ae35a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.722322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6006776d6ecf45f19d9f1d2bf1393fd1', 'request_id': 'req-eb9b8020-3e18-4375-bd0f-2fda951ae35a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.729641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6006776d6ecf45f19d9f1d2bf1393fd1', 'request_id': 'req-eb9b8020-3e18-4375-bd0f-2fda951ae35a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.777731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77735-6405-4e12-b657-44d2b0e33794 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:44.782656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:44.783527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.783811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.784089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] PATH_INFO: `/v3/users/5178965410cc41889381fbd430d5ed31` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.785318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5178965410cc41889381fbd430d5ed31)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:44.787230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:44.799263 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] The token cache is being invalidate because project 6006776d6ecf45f19d9f1d2bf1393fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:44.799563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.807764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-eb9b8020-3e18-4375-bd0f-2fda951ae35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:44.807764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1041/2118] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:44 2021] DELETE /identity/v3/projects/6006776d6ecf45f19d9f1d2bf1393fd1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:44.807764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6a6b-2868-47dd-9b8d-7d5bc6488f22 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.807764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6a6b-2868-47dd-9b8d-7d5bc6488f22 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.807764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6a6b-2868-47dd-9b8d-7d5bc6488f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.821950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4e6e6a6b-2868-47dd-9b8d-7d5bc6488f22 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:44.822589 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4e6e6a6b-2868-47dd-9b8d-7d5bc6488f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.833869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1042/2119] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:44.835229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.835514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.842574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.853679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:44.855116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.862818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1043/2120] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:44.863581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:44.864857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.920226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1969-2b48-4f92-a7a5-413e2aa7c982 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:44.923955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0d8b3-fa57-4037-875e-f923fe3a720c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:44.924655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d8b3-fa57-4037-875e-f923fe3a720c service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.924951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d8b3-fa57-4037-875e-f923fe3a720c service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.925235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d8b3-fa57-4037-875e-f923fe3a720c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.935031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0d8b3-fa57-4037-875e-f923fe3a720c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:44.940336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0d8b3-fa57-4037-875e-f923fe3a720c service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:44.946382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1044/2121] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:44.947601 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.947970 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.948165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.965957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:44.967046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:44.975286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1045/2122] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:44.979826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:44.988251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490cfaf-3c9a-41dc-be0a-f5bd4d5d41de None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:44.993620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:44.994383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:44.994807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:44.995377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:44.996533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:27:44.997003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:44.999512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.021939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1046/2123] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:27:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:27:45.023463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.035731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0267-a5e5-4633-95cb-d26f1f690bca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.038725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5178965410cc41889381fbd430d5ed31'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.041903 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.043060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.043060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.043480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.044206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.046184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.122900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5178965410cc41889381fbd430d5ed31'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.135874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5178965410cc41889381fbd430d5ed31'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.142546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5178965410cc41889381fbd430d5ed31'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.143189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-963ae5eb-96a6-4b84-9379-87c791d4acd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5178965410cc41889381fbd430d5ed31'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.149039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1078/2124] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:44 2021] DELETE /identity/v3/users/5178965410cc41889381fbd430d5ed31 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:45.157664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.157963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.158245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.162895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1047/2125] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:45 2021] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:45.167537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.169352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.178898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:45.180178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.248850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1079/2126] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:27:45.257149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf517f4-0564-4fda-b613-17d89e0f58e7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.260062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.261825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.263935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.264658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.264968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.271788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.271788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.271788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.321041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb4233-a270-4345-bc2d-235678450ec6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.325139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.326222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.326499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.326782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.336551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.337985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.355695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1080/2127] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:27:45.367481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1048/2128] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:45 2021] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:45.368823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.380701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4dee-9c92-493a-9343-f55f1cb290a1 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.385909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.386571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.386857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.387137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.387911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.391184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.401880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1081/2129] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:27:45.405959 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.416726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706eb75-6d3d-4844-9c4d-288d00f3a97f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.424625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.426540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.430956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.431750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.432038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.432390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.440041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.441441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.463219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1049/2130] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:45.467670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.490283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c670e-2c37-4b45-aaf7-7779e294a132 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.522213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df0c6-4f2f-4530-8c06-7585e1b59352 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.522368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55425f15-d77e-40a8-9a24-3c36c0c16dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.523210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425f15-d77e-40a8-9a24-3c36c0c16dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.523528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425f15-d77e-40a8-9a24-3c36c0c16dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.523863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425f15-d77e-40a8-9a24-3c36c0c16dd5 admin admin] PATH_INFO: `/v3/projects/1cb03871d47b477d983b085c6f746418/users/326ff52bc1d54990aa2be5c5e4de19cf/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.527714 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.528599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.528886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.529159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] PATH_INFO: `/v3/projects/a65f459abc4844db84a3651943fd5d10` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.530478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65f459abc4844db84a3651943fd5d10)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.532370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.539729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55425f15-d77e-40a8-9a24-3c36c0c16dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb03871d47b477d983b085c6f746418, user_id=326ff52bc1d54990aa2be5c5e4de19cf, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.542576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55425f15-d77e-40a8-9a24-3c36c0c16dd5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.627034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1050/2131] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:45 2021] PUT /identity/v3/projects/1cb03871d47b477d983b085c6f746418/users/326ff52bc1d54990aa2be5c5e4de19cf/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:45.640237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.640562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.641018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.642217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65f459abc4844db84a3651943fd5d10', 'request_id': 'req-c341affa-e2bd-484f-83c7-4612aa80aedb'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.648452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65f459abc4844db84a3651943fd5d10', 'request_id': 'req-c341affa-e2bd-484f-83c7-4612aa80aedb'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.655139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65f459abc4844db84a3651943fd5d10', 'request_id': 'req-c341affa-e2bd-484f-83c7-4612aa80aedb'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.671546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] MFA Rules not processed for user `326ff52bc1d54990aa2be5c5e4de19cf`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:45.672821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.743095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1051/2132] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:45 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:27:45.761113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] The token cache is being invalidate because project a65f459abc4844db84a3651943fd5d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:45.761638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.762712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:45.764220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1082/2133] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:45 2021] DELETE /identity/v3/projects/a65f459abc4844db84a3651943fd5d10 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:45.773679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.773679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.852446 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569ebd-0ef0-4144-bb6a-9db46fa18dfc None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.856860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.857579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.857827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.858110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.860162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.867978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:45.869521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:45.879602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.902265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:45.902265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1052/2134] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:45 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:45.957375 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341affa-e2bd-484f-83c7-4612aa80aedb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:45.962681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:45.963544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:45.963837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:45.964145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] PATH_INFO: `/v3/projects/78acfa237bf345e98665d9e59beeeb75` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:45.965371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78acfa237bf345e98665d9e59beeeb75)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:45.967266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:46.116639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78acfa237bf345e98665d9e59beeeb75', 'request_id': 'req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.122002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78acfa237bf345e98665d9e59beeeb75', 'request_id': 'req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.128219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78acfa237bf345e98665d9e59beeeb75', 'request_id': 'req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.262352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] The token cache is being invalidate because project 78acfa237bf345e98665d9e59beeeb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:46.262760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.263391 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.264996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1083/2135] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:45 2021] DELETE /identity/v3/projects/78acfa237bf345e98665d9e59beeeb75 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:46.269026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:46.280164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dde85-ea0a-4ffd-9d43-067679ca2f3d service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:46.335828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:46.336723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:46.337006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:46.337280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] PATH_INFO: `/v3/users/ff6ca9f79d4247278ae167cf0ea42980` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:46.338442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6ca9f79d4247278ae167cf0ea42980)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:46.340385 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:46.641992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6ca9f79d4247278ae167cf0ea42980'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.643425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6ca9f79d4247278ae167cf0ea42980'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.644242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6ca9f79d4247278ae167cf0ea42980'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.785894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6ca9f79d4247278ae167cf0ea42980'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.804203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-989f88b8-a58d-4f09-b69c-211681f4f011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6ca9f79d4247278ae167cf0ea42980'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:46.826454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1053/2136] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:27:46 2021] DELETE /identity/v3/users/ff6ca9f79d4247278ae167cf0ea42980 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:47.566665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:47.568991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:47.581877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e127-b072-4a5f-a52e-5ffa1f1bf6f3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:47.640592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:47.641457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:47.641763 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:47.642032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] PATH_INFO: `/v3/projects/9cb2c89a3d4449978d245872ed46fcdb` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:47.643322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb2c89a3d4449978d245872ed46fcdb)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:47.645283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:47.841177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb2c89a3d4449978d245872ed46fcdb', 'request_id': 'req-922c8f8d-9735-45f8-b50f-ecaffddfdb59'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:47.846624 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb2c89a3d4449978d245872ed46fcdb', 'request_id': 'req-922c8f8d-9735-45f8-b50f-ecaffddfdb59'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:47.853241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb2c89a3d4449978d245872ed46fcdb', 'request_id': 'req-922c8f8d-9735-45f8-b50f-ecaffddfdb59'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:47.953882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] The token cache is being invalidate because project 9cb2c89a3d4449978d245872ed46fcdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:27:47.954177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:47.954793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-922c8f8d-9735-45f8-b50f-ecaffddfdb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:27:47.956308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1084/2137] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:27:47 2021] DELETE /identity/v3/projects/9cb2c89a3d4449978d245872ed46fcdb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:27:47.965714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:47.966162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:47.966253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.011372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:48.012587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:48.070368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1054/2138] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:48.076574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.076876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.077159 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.096290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:48.097531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:48.105919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1085/2139] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:48.111671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.122026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b6db-1608-48dd-b2b0-1a2d59c8f6af None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.126754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.127479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.127764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.128043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.128802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:27:48.129113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.131328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.146740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1055/2140] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:27:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:27:48.147918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.157205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77deb2af-178b-4b8b-8628-75ff46c07f50 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.162383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.162925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.163212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.163492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.164224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.166175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.258812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1086/2141] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:48 2021] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:48.260271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.270444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601b6f4-f744-451a-9b8e-0c192e532e2c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.331990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.332750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.333028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.333340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.334032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.335986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.423187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1056/2142] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:48 2021] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:48.424440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.435279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54646436-b65a-4182-b182-7a00af55aed1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.439893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.440610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.442790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.442790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.442790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.443421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.453903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1087/2143] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:48.457975 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.467986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de97d4-1950-40bc-88da-a91fc39c10ae admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.472592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b73e3-a191-4667-b0fd-2fa5df81658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.473243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b73e3-a191-4667-b0fd-2fa5df81658a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.473524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b73e3-a191-4667-b0fd-2fa5df81658a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.474295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b73e3-a191-4667-b0fd-2fa5df81658a admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.475023 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b73e3-a191-4667-b0fd-2fa5df81658a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.476642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b73e3-a191-4667-b0fd-2fa5df81658a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.486972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1057/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:27:48.491954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.501884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5825-29d8-43bd-abc3-92559b52f9ac admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.506476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.507341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.507630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.511695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] PATH_INFO: `/v3/projects/9768cf89a22e4adf9feedd402cdde0c8/users/caaefc1301484797a60bb2d5085e029d/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.521939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9768cf89a22e4adf9feedd402cdde0c8, user_id=caaefc1301484797a60bb2d5085e029d, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.524691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.699756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1088/2145] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:48 2021] PUT /identity/v3/projects/9768cf89a22e4adf9feedd402cdde0c8/users/caaefc1301484797a60bb2d5085e029d/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:48.704954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06397f2a-e8f2-479d-a93a-bef47d0aaa3e None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.705354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06397f2a-e8f2-479d-a93a-bef47d0aaa3e None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.705703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06397f2a-e8f2-479d-a93a-bef47d0aaa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.727030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-06397f2a-e8f2-479d-a93a-bef47d0aaa3e None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:48.728223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-06397f2a-e8f2-479d-a93a-bef47d0aaa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:48.784725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1058/2146] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:48.795013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:48.796814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:48.870090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788657-f16f-4f66-aa04-a58da4445664 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:48.873734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:48.874373 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:48.874657 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:48.874939 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:48.883567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:48.885007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:48.893997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1089/2147] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:27:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:27:54.989965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:54.990493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:54.990583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.016208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] MFA Rules not processed for user `caaefc1301484797a60bb2d5085e029d`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:27:55.017465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:27:55.083858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1059/2148] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:27:54 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:27:55.087908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:55.097948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda89e1b-0311-450e-8024-519f6e221359 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:55.104190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:55.105148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:55.105443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:55.105725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.106452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:55.108345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:55.255981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1090/2149] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:27:55 2021] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:27:55.259943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:55.273288 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785387de-9020-42e2-8a2f-bb0b34b196d8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:55.335631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:55.336434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:55.336732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:55.337009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.337706 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:55.339593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:55.420357 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1060/2150] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:27:55 2021] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:27:55.424318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:55.437854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326259-0725-4fa7-984c-a8704d32e0b1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:55.442676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:55.443350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:55.443637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:55.443943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.444703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:55.446273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:55.456909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1091/2151] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:27:55.461499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:55.471872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d3f39-3e5c-428c-9f8e-6c48ceaaad97 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:55.477335 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:55.478270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:55.478560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:55.478832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] PATH_INFO: `/v3/projects/3120a44308864f608a8b232cce6830bd/users/8c282a87a2674837b686314cb7c23c2f/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.493826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3120a44308864f608a8b232cce6830bd, user_id=8c282a87a2674837b686314cb7c23c2f, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:55.496523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:55.591300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1061/2152] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:55 2021] PUT /identity/v3/projects/3120a44308864f608a8b232cce6830bd/users/8c282a87a2674837b686314cb7c23c2f/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:27:55.595339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:55.606131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1551fb1-d3a7-4fdd-be94-ce6280541417 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:55.664738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794df1bf-4a64-4095-a438-2258c6d6fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:55.665180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794df1bf-4a64-4095-a438-2258c6d6fde6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:55.665473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794df1bf-4a64-4095-a438-2258c6d6fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:55.665755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794df1bf-4a64-4095-a438-2258c6d6fde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.666482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794df1bf-4a64-4095-a438-2258c6d6fde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:55.668058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794df1bf-4a64-4095-a438-2258c6d6fde6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:55.678238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1092/2153] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:27:55 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:27:55.682642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:27:55.692994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01171-fa18-4f82-ac33-5c322d6a108f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:27:55.697699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:27:55.704577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:27:55.704577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:27:55.704577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] PATH_INFO: `/v3/projects/3120a44308864f608a8b232cce6830bd/users/8c282a87a2674837b686314cb7c23c2f/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:27:55.704577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3120a44308864f608a8b232cce6830bd, user_id=8c282a87a2674837b686314cb7c23c2f, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:27:55.704577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:27:55.715518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1062/2154] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:27:55 2021] PUT /identity/v3/projects/3120a44308864f608a8b232cce6830bd/users/8c282a87a2674837b686314cb7c23c2f/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:28:02.174818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f254-7207-4339-b964-9787cce674de None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:02.175340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f254-7207-4339-b964-9787cce674de None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:02.175461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f254-7207-4339-b964-9787cce674de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:02.205593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a179f254-7207-4339-b964-9787cce674de None None] MFA Rules not processed for user `8c282a87a2674837b686314cb7c23c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:02.206928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a179f254-7207-4339-b964-9787cce674de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:02.294487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1093/2155] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:02 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:28:02.340912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:02.342908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:02.423285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9d15c-19d0-46ee-93c4-3ac370aa53ec admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:02.429423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbafc2-a459-4535-a8b7-2b0f1e90586c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:02.430065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbafc2-a459-4535-a8b7-2b0f1e90586c service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:02.432765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbafc2-a459-4535-a8b7-2b0f1e90586c service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:02.432765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbafc2-a459-4535-a8b7-2b0f1e90586c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:02.484670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbafc2-a459-4535-a8b7-2b0f1e90586c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:02.486280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbafc2-a459-4535-a8b7-2b0f1e90586c service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:02.495986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1063/2156] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:02 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:05.501329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:05.502294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:05.502828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:05.524834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] MFA Rules not processed for user `caaefc1301484797a60bb2d5085e029d`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:05.526385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:05.533950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1094/2157] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:05 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:06.763333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0d798-d863-4636-8026-289a4c52400c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:06.767650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0d798-d863-4636-8026-289a4c52400c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:06.767650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0d798-d863-4636-8026-289a4c52400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:06.792364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-97d0d798-d863-4636-8026-289a4c52400c None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:06.793656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-97d0d798-d863-4636-8026-289a4c52400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:06.847070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1064/2158] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:28:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:06.890846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:06.892310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:06.975207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a2590-3301-4073-87c0-3832bef11d9d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:06.981988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0747570-6916-45f4-af0c-388a60fefa08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:06.982740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0747570-6916-45f4-af0c-388a60fefa08 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:06.983104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0747570-6916-45f4-af0c-388a60fefa08 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:06.983395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0747570-6916-45f4-af0c-388a60fefa08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:06.992285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0747570-6916-45f4-af0c-388a60fefa08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:06.996763 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0747570-6916-45f4-af0c-388a60fefa08 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:07.005675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1095/2159] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:28:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:28:07.403486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0d798-d863-4636-8026-289a4c52400c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:07.403486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-97d0d798-d863-4636-8026-289a4c52400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:07.535266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0d798-d863-4636-8026-289a4c52400c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:07.559086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:07.560772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:07.561086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:07.561390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] PATH_INFO: `/v3/users/326ff52bc1d54990aa2be5c5e4de19cf` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:07.564204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=326ff52bc1d54990aa2be5c5e4de19cf)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:07.568670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:07.959630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326ff52bc1d54990aa2be5c5e4de19cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:07.964571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326ff52bc1d54990aa2be5c5e4de19cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:07.965719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326ff52bc1d54990aa2be5c5e4de19cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:08.139503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326ff52bc1d54990aa2be5c5e4de19cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:08.157349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326ff52bc1d54990aa2be5c5e4de19cf'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:08.179490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1065/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:28:07 2021] DELETE /identity/v3/users/326ff52bc1d54990aa2be5c5e4de19cf => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:28:08.180498 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:08.181015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:08.181237 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:08.204248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:08.205949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:08.325025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1096/2161] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:28:08.339752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:08.341690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:08.428872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b6eb-fe7e-42b2-a457-46a35b83cbe5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:08.434237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcb96d-5836-4a57-b91b-77da6db763e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:08.434995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcb96d-5836-4a57-b91b-77da6db763e4 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:08.435281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcb96d-5836-4a57-b91b-77da6db763e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:08.435556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcb96d-5836-4a57-b91b-77da6db763e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:08.446948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcb96d-5836-4a57-b91b-77da6db763e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:08.448403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcb96d-5836-4a57-b91b-77da6db763e4 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:08.462061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1066/2162] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:09.002354 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:09.004173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:09.017884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b63ce-4726-4c42-b143-66dbd24cd769 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:09.031964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:09.032883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:09.033343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:09.033774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] PATH_INFO: `/v3/projects/1cb03871d47b477d983b085c6f746418` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:09.046802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb03871d47b477d983b085c6f746418)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:09.048994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:09.217757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb03871d47b477d983b085c6f746418', 'request_id': 'req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:09.225534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb03871d47b477d983b085c6f746418', 'request_id': 'req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:09.245974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb03871d47b477d983b085c6f746418', 'request_id': 'req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:09.345862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] The token cache is being invalidate because project 1cb03871d47b477d983b085c6f746418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:28:09.345982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:09.349659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-98fc74e1-6d10-4446-99d2-1f6aeb7e3a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:09.355777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1097/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:28:09 2021] DELETE /identity/v3/projects/1cb03871d47b477d983b085c6f746418 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:28:09.372579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:09.373464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:09.373898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:09.416004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:09.417832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:09.531418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1067/2164] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:09.541183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:09.541807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:09.542417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:09.571863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:09.573858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:09.589640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1098/2165] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:09.589776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:09.606307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b0d3-cbe4-4f26-a5ac-aa52dce9c514 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:09.611113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:09.611767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:09.612075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:09.612499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:09.613264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:28:09.613581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:09.615170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:09.634652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1068/2166] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:28:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:28:09.640955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:09.650689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce65d9-0e6d-4436-b019-1ade1c4d71c9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:09.657969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:09.658934 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:09.659388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:09.660109 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:09.661281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:09.663775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:09.781061 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1099/2167] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:28:09 2021] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:28:09.785966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:09.800123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fc5b6-9fd0-454d-a7e3-1fe32bd70550 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:09.886848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:09.887840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:09.888294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:09.888621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:09.889310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:09.891301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:09.983908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1069/2168] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:28:09 2021] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:28:09.989183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:10.008873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a18b-5c0d-41d8-930d-f7842d13bb7a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:10.017875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:10.018638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:10.019021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:10.019446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:10.020386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:10.022289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:10.033634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1100/2169] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:28:09 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:28:10.038284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:10.048955 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13641-9204-4871-9035-133a059d59ff admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:10.054256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94161c30-84d9-457d-8131-3a20ef7ec790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:10.054918 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161c30-84d9-457d-8131-3a20ef7ec790 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:10.055199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161c30-84d9-457d-8131-3a20ef7ec790 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:10.055475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161c30-84d9-457d-8131-3a20ef7ec790 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:10.056206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94161c30-84d9-457d-8131-3a20ef7ec790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:10.057860 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94161c30-84d9-457d-8131-3a20ef7ec790 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:10.072482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1070/2170] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:28:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:28:10.076353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:10.086186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef4a98-06a0-41a8-889c-5844499171ff admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:10.105385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:10.106409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:10.106799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:10.107136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] PATH_INFO: `/v3/projects/85d8c4df46ab43c298282acae2b43512/users/0685182b9a2f48b89f8198ab861214e0/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:10.128462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d8c4df46ab43c298282acae2b43512, user_id=0685182b9a2f48b89f8198ab861214e0, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:10.128462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:10.560887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1101/2171] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:28:10 2021] PUT /identity/v3/projects/85d8c4df46ab43c298282acae2b43512/users/0685182b9a2f48b89f8198ab861214e0/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:28:10.566368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309496-8368-4ffb-ab20-6283a7ef4ae6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:10.566811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309496-8368-4ffb-ab20-6283a7ef4ae6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:10.566920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309496-8368-4ffb-ab20-6283a7ef4ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:10.585808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-97309496-8368-4ffb-ab20-6283a7ef4ae6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:10.587033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-97309496-8368-4ffb-ab20-6283a7ef4ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:10.648847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1071/2172] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:10.659075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:10.661535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:10.730559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac46ee-19e8-43f3-a0b3-3e880d3c44c2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:10.737081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:10.737081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:10.737081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:10.737081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:10.747647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:10.749599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:10.776532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1102/2173] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:28:18.694421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:18.695620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:18.696062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:18.734669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] MFA Rules not processed for user `0685182b9a2f48b89f8198ab861214e0`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:18.741598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:18.886875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1072/2174] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:18 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:18.891614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:18.907219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634127d-f5b7-4d0a-9b56-e992a89d6d7d service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:18.920562 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:18.921520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:18.921963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:18.922408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:18.923262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:18.929430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:19.114451 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1103/2175] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:28:18 2021] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:28:19.118390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:19.141723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7b839-c455-4759-b7c0-4836170bab5f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:19.280476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:19.280476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:19.280476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:19.281211 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:19.283181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:19.298872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:19.443799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1073/2176] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:28:19 2021] POST /identity/v3/users => generated 295 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:28:19.445742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:19.466180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eacfe-9720-453b-a5f1-4f62c000c3ba admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:19.474135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:19.475013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:19.475405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:19.475742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:19.476559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:19.508576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:19.508576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1104/2177] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:28:19 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:28:19.509231 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:19.516894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb043-1607-4934-bccd-14bcb4586b11 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:19.641051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3128-d827-4968-9829-227747719d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:19.641051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3128-d827-4968-9829-227747719d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:19.641051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3128-d827-4968-9829-227747719d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:19.641051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3128-d827-4968-9829-227747719d1f admin admin] PATH_INFO: `/v3/projects/494dfcbdcf724dd381c87003750012a4/users/f68c7d3ce15148528ec0dab12ceb3cd3/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:19.645271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3128-d827-4968-9829-227747719d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=494dfcbdcf724dd381c87003750012a4, user_id=f68c7d3ce15148528ec0dab12ceb3cd3, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:19.645271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3128-d827-4968-9829-227747719d1f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:20.302825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1074/2178] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:28:19 2021] PUT /identity/v3/projects/494dfcbdcf724dd381c87003750012a4/users/f68c7d3ce15148528ec0dab12ceb3cd3/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:28:20.303572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:20.314583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b88cd9-2833-49f6-95fe-1b29d70d5e77 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:20.438025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:20.439389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:20.439904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:20.440396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:20.442004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:20.444005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:20.455608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1105/2179] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:28:20 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:28:20.459378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3128-d827-4968-9829-227747719d1f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:20.485575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3128-d827-4968-9829-227747719d1f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:20.492033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17456337-a23a-4837-912e-265ee0c1d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:20.492916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17456337-a23a-4837-912e-265ee0c1d2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:20.493338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17456337-a23a-4837-912e-265ee0c1d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:20.493621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17456337-a23a-4837-912e-265ee0c1d2fa admin admin] PATH_INFO: `/v3/projects/494dfcbdcf724dd381c87003750012a4/users/f68c7d3ce15148528ec0dab12ceb3cd3/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:20.495680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17456337-a23a-4837-912e-265ee0c1d2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=494dfcbdcf724dd381c87003750012a4, user_id=f68c7d3ce15148528ec0dab12ceb3cd3, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:20.499774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17456337-a23a-4837-912e-265ee0c1d2fa admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:20.513518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1075/2180] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:28:20 2021] PUT /identity/v3/projects/494dfcbdcf724dd381c87003750012a4/users/f68c7d3ce15148528ec0dab12ceb3cd3/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:28:26.621996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:26.624173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:26.736136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287ab95-cb9b-4e77-9bc7-47eb8ddb1917 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:26.835105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:26.837766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:26.837766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:26.837766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:26.838389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:26.851293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:26.853198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:26.868075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1106/2181] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:27.506626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cdebd-d42d-455b-a091-55ea84ae79aa None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:27.507528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cdebd-d42d-455b-a091-55ea84ae79aa None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:27.508824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cdebd-d42d-455b-a091-55ea84ae79aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:27.543012 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a42cdebd-d42d-455b-a091-55ea84ae79aa None None] MFA Rules not processed for user `f68c7d3ce15148528ec0dab12ceb3cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:27.544596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a42cdebd-d42d-455b-a091-55ea84ae79aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:27.705213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1076/2182] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:27 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:27.986820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:27.988728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:28.120761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc276f55-8250-4f90-b88d-3ecd3514eee0 service placement] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:28.127977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba64535-fafe-4f48-8551-c67881d7d25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:28.129157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba64535-fafe-4f48-8551-c67881d7d25f service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:28.129449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba64535-fafe-4f48-8551-c67881d7d25f service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:28.129988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba64535-fafe-4f48-8551-c67881d7d25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:28.212819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba64535-fafe-4f48-8551-c67881d7d25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:28.214588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba64535-fafe-4f48-8551-c67881d7d25f service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:28.225002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1107/2183] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:27 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:30.278816 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e916-34cb-4738-941a-faecc3cdd42d None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:30.279380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e916-34cb-4738-941a-faecc3cdd42d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:30.279815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e916-34cb-4738-941a-faecc3cdd42d None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:30.281998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1077/2184] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:28:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:28:30.290157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1788d7-10a4-4037-a552-098966e3953a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:30.290731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1788d7-10a4-4037-a552-098966e3953a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:30.290731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1788d7-10a4-4037-a552-098966e3953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:30.333689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-cb1788d7-10a4-4037-a552-098966e3953a None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:30.335247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cb1788d7-10a4-4037-a552-098966e3953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:30.346960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1108/2185] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:28:30 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:30.373664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e916-34cb-4738-941a-faecc3cdd42d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:30.375825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f355e916-34cb-4738-941a-faecc3cdd42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:30.445237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e916-34cb-4738-941a-faecc3cdd42d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:30.449649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6cc8-4e58-4436-9111-579d28b38053 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:30.450771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6cc8-4e58-4436-9111-579d28b38053 service glance] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:30.451125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6cc8-4e58-4436-9111-579d28b38053 service glance] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:30.451476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6cc8-4e58-4436-9111-579d28b38053 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:30.464432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6cc8-4e58-4436-9111-579d28b38053 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:30.466935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6cc8-4e58-4436-9111-579d28b38053 service glance] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:30.483122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1078/2186] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:30.760276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8585ad-58cc-4551-b95e-d1586abcf115 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:30.760795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8585ad-58cc-4551-b95e-d1586abcf115 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:30.761342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8585ad-58cc-4551-b95e-d1586abcf115 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:30.763406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1109/2187] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:28:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:28:30.770164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d23fff-db34-4ffb-be88-650c11781c31 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:30.770772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d23fff-db34-4ffb-be88-650c11781c31 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:30.771260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d23fff-db34-4ffb-be88-650c11781c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:30.830051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c4d23fff-db34-4ffb-be88-650c11781c31 None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:30.831508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c4d23fff-db34-4ffb-be88-650c11781c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:30.904140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1079/2188] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:28:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:30.949259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8585ad-58cc-4551-b95e-d1586abcf115 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:30.971513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8585ad-58cc-4551-b95e-d1586abcf115 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:30.981675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:30.982549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:30.982851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:30.983207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:30.991034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:30.992475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:31.000070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1110/2189] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:37.326117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1dd4-bcc5-4b72-94f0-47347b13f3b4 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:37.326610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1dd4-bcc5-4b72-94f0-47347b13f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:37.326884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c1dd4-bcc5-4b72-94f0-47347b13f3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:37.349494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-010c1dd4-bcc5-4b72-94f0-47347b13f3b4 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:37.350698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-010c1dd4-bcc5-4b72-94f0-47347b13f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:37.413026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1080/2190] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:28:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:37.426941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:37.428370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:37.501191 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb522c1-c56a-4ccd-bd9b-1f02c2234b10 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:37.509030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:37.509292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:37.509578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:37.509857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:37.518518 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:37.520158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:37.528359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1111/2191] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:28:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:28:54.155884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:54.156492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:54.156492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:54.174488 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] MFA Rules not processed for user `0685182b9a2f48b89f8198ab861214e0`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:54.175743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:54.182880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1081/2192] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:54 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:55.632251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:55.633755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:55.697959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952df94e-94c0-46cb-a625-b3ae377fa742 service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:55.702424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:55.703392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:55.703686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:55.703966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] PATH_INFO: `/v3/users/19410737ca1d477b8e5258d11f2ed33e` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:55.705180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19410737ca1d477b8e5258d11f2ed33e)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:55.707083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:55.910590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19410737ca1d477b8e5258d11f2ed33e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:55.989936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19410737ca1d477b8e5258d11f2ed33e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.002067 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19410737ca1d477b8e5258d11f2ed33e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.008908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19410737ca1d477b8e5258d11f2ed33e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.009553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1d4949a1-727c-4de5-94c4-ce4b21e78a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19410737ca1d477b8e5258d11f2ed33e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.015337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1112/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:28:55 2021] DELETE /identity/v3/users/19410737ca1d477b8e5258d11f2ed33e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:28:56.259723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:56.271402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5d7b-8a33-4578-9c9a-db13c69b9e0a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:56.326020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:56.326889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:56.327182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:56.327461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] PATH_INFO: `/v3/projects/794fe0b68dcf4ced9125be94786be1bd` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:56.328686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] RBAC: Authorizing `identity:delete_project(project_id=794fe0b68dcf4ced9125be94786be1bd)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:56.330580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:56.500249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794fe0b68dcf4ced9125be94786be1bd', 'request_id': 'req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.506032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794fe0b68dcf4ced9125be94786be1bd', 'request_id': 'req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.511877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794fe0b68dcf4ced9125be94786be1bd', 'request_id': 'req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.600304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] The token cache is being invalidate because project 794fe0b68dcf4ced9125be94786be1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:28:56.600659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.605869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0bce9ba-9881-48bf-9ad0-f7fffd3c923e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:28:56.605869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1082/2194] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:28:56 2021] DELETE /identity/v3/projects/794fe0b68dcf4ced9125be94786be1bd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:28:56.610566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:56.610933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:56.611294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:56.629744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:56.634564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:56.690016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1113/2195] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:28:56.698393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:56.698707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:56.698951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:56.717895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:56.720654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:56.728841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1083/2196] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:56.733262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:56.742617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8c1d8-1377-4442-a010-becfcdb4620b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:56.747344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:56.747995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:56.749333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:56.749333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:56.749587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:28:56.749902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:56.751478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:56.763471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1114/2197] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:28:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:28:56.768018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:56.777659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0f97a-98ef-4155-8b24-187bb14a381a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:56.783819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:56.783819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:56.783819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:56.783819 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:56.784299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:56.786732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:56.884203 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:56.885985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:56.902438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1084/2198] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:28:56 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:28:56.906895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:56.958535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e0d60-c046-4c59-ae39-a104a916f0eb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:56.982020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d74be-5d41-4eda-a8e4-3281a2d5fbab admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:56.987508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:56.988250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:56.988577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:56.988905 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:56.989595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:56.991567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:57.014352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:57.014911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:57.015198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:57.015477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:57.017448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:57.079885 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:57.081346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:57.101253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1115/2199] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:56 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:28:57.101407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1085/2200] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:28:56 2021] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:28:57.101407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:57.105622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e811-0f81-4729-9899-a51be469a1f7 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:57.110266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:57.110934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:57.111219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:57.111498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:57.112222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:57.113879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:57.123843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1086/2201] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:28:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:28:57.128084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:57.138845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758259-9dd4-4366-b4bd-776063a98a5b service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:57.143615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ccb2e-3afe-4331-8912-fd65bad895a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:57.144800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ccb2e-3afe-4331-8912-fd65bad895a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:57.145090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ccb2e-3afe-4331-8912-fd65bad895a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:57.145362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ccb2e-3afe-4331-8912-fd65bad895a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:57.146082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ccb2e-3afe-4331-8912-fd65bad895a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:57.147891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ccb2e-3afe-4331-8912-fd65bad895a6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:57.158570 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1116/2202] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:28:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:28:57.163122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:57.173451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dee3e8-0ba1-4ef2-9711-e889f45ff0df admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:57.178207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:57.181609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:57.181609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:57.181609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] PATH_INFO: `/v3/projects/361ef28e90404c6eb5996daa7a9e6a74/users/93c8f0d024444a03b69fd786300576e7/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:57.193952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] RBAC: Authorizing `identity:create_grant(project_id=361ef28e90404c6eb5996daa7a9e6a74, user_id=93c8f0d024444a03b69fd786300576e7, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:57.196611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:57.332463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1087/2203] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:28:57 2021] PUT /identity/v3/projects/361ef28e90404c6eb5996daa7a9e6a74/users/93c8f0d024444a03b69fd786300576e7/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:28:57.342783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cdf92-4425-45b6-a8c4-f1bed829910a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:57.343076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cdf92-4425-45b6-a8c4-f1bed829910a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:57.343356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cdf92-4425-45b6-a8c4-f1bed829910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:57.371521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-967cdf92-4425-45b6-a8c4-f1bed829910a None None] MFA Rules not processed for user `93c8f0d024444a03b69fd786300576e7`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:28:57.372837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-967cdf92-4425-45b6-a8c4-f1bed829910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:57.444928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1117/2204] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:28:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:28:57.452034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:28:57.457618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:28:57.529977 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d7287-eafc-47c8-a290-413d21fe958d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:28:57.537874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:28:57.538619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:28:57.538974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:28:57.539346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:28:57.547674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:28:57.549302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:28:57.558632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1088/2205] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:28:57 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:04.890492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:04.891057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:04.891057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:04.940858 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:04.942054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:05.005051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1118/2206] 10.222.0.20 () {58 vars in 968 bytes} [Tue Sep 14 22:29:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:05.017884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:05.019330 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:05.111540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c356-4ef9-49b4-bbb1-fc968acfc958 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:05.116752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340164c-21fe-4933-8bd4-07178822e737 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:05.117409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340164c-21fe-4933-8bd4-07178822e737 service swift] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:05.117692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340164c-21fe-4933-8bd4-07178822e737 service swift] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:05.117969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340164c-21fe-4933-8bd4-07178822e737 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:05.126071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340164c-21fe-4933-8bd4-07178822e737 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:05.127637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340164c-21fe-4933-8bd4-07178822e737 service swift] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:05.135791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1089/2207] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:29:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:29:07.166517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:07.242949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be777830-213a-4ebb-abbb-12777dd65a7d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:07.249273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:07.250450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:07.250883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:07.251310 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] PATH_INFO: `/v3/users/93c8f0d024444a03b69fd786300576e7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:07.253086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c8f0d024444a03b69fd786300576e7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:07.254924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:07.471096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c8f0d024444a03b69fd786300576e7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:07.529524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c8f0d024444a03b69fd786300576e7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:07.542648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c8f0d024444a03b69fd786300576e7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:07.549401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c8f0d024444a03b69fd786300576e7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:07.550113 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c8f0d024444a03b69fd786300576e7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:07.556482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1119/2208] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:07 2021] DELETE /identity/v3/users/93c8f0d024444a03b69fd786300576e7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:07.560940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:07.561402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:07.561513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:07.580679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:07.581799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:07.642462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1090/2209] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:07.653505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:07.654956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:07.721943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca2d0-5032-4bb3-a7f1-43432a118724 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:07.728550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142e639-b73d-4efe-8faa-1b59f1aa9636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:07.729307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142e639-b73d-4efe-8faa-1b59f1aa9636 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:07.729976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142e639-b73d-4efe-8faa-1b59f1aa9636 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:07.730333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142e639-b73d-4efe-8faa-1b59f1aa9636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:07.739605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142e639-b73d-4efe-8faa-1b59f1aa9636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:07.741252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142e639-b73d-4efe-8faa-1b59f1aa9636 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:07.750884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1120/2210] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:08.171862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:08.173312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:08.186909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e98150-a48a-4466-86f1-4d641ee03626 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:08.192041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:08.192969 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.196053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.196053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] PATH_INFO: `/v3/projects/361ef28e90404c6eb5996daa7a9e6a74` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.196053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361ef28e90404c6eb5996daa7a9e6a74)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:08.197309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:08.346456 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361ef28e90404c6eb5996daa7a9e6a74', 'request_id': 'req-f4cbaa1c-26c8-467a-b259-186b1ac456a8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:08.351743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361ef28e90404c6eb5996daa7a9e6a74', 'request_id': 'req-f4cbaa1c-26c8-467a-b259-186b1ac456a8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:08.358084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361ef28e90404c6eb5996daa7a9e6a74', 'request_id': 'req-f4cbaa1c-26c8-467a-b259-186b1ac456a8'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:08.440878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] The token cache is being invalidate because project 361ef28e90404c6eb5996daa7a9e6a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:08.441174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:08.441875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-f4cbaa1c-26c8-467a-b259-186b1ac456a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:08.444314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1091/2211] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:08 2021] DELETE /identity/v3/projects/361ef28e90404c6eb5996daa7a9e6a74 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:08.450018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.450584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.450584 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.468749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:08.470020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:08.530499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1121/2212] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:08.539758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.540046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.540320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.559322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:08.560583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:08.568599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1092/2213] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:08.572835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:08.582720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a29b5-59f5-455a-a3f5-e7c5ead6c912 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:08.587484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:08.588156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.588623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.588899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.589626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:08.589933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:08.591516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:08.607265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1122/2214] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:08.608351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:08.617963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2ad30-c90c-434d-b324-106d423f614d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:08.622707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:08.623360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.623640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.623916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.624632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:08.626526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:08.714772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1093/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:08 2021] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:08.720279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:08.732679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5fe8-7c07-4aac-b42d-c7c70f7c533e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:08.797431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:08.798102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.798388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.798667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.799351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:08.801318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:08.933185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1123/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:08 2021] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:08.937401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:08.948831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc218709-86cf-468e-863e-cc8b57aa2095 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:08.953587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:08.954258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.954545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.954826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.955557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:08.957365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:08.968324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1094/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:08.972314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:08.983303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529372-45f7-4a98-ae8d-f156e2d86c71 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:08.990578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5af86a-ba1b-482c-baaa-b706ac48a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:08.991260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5af86a-ba1b-482c-baaa-b706ac48a774 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:08.994175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5af86a-ba1b-482c-baaa-b706ac48a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:08.994175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5af86a-ba1b-482c-baaa-b706ac48a774 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:08.994175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5af86a-ba1b-482c-baaa-b706ac48a774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:08.994175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5af86a-ba1b-482c-baaa-b706ac48a774 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:09.004777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1124/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:09.009901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:09.020006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bf151-411f-4da0-b7d0-c8f2650c0d3f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:09.024999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:09.025868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:09.026144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:09.026416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] PATH_INFO: `/v3/projects/52c18737ebe84736883ae086f852a5ca/users/df959c548162491da82a5a8c6dd75470/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:09.041205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c18737ebe84736883ae086f852a5ca, user_id=df959c548162491da82a5a8c6dd75470, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:09.043817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:09.115475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1095/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:09 2021] PUT /identity/v3/projects/52c18737ebe84736883ae086f852a5ca/users/df959c548162491da82a5a8c6dd75470/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:09.125862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:09.126158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:09.126443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:09.153527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] MFA Rules not processed for user `df959c548162491da82a5a8c6dd75470`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:09.154652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:09.215476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1125/2220] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:09 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:09.231073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:09.231767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:09.233987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:09.237817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:09.316944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02820d8-3e60-4a85-8ed1-366a36b55814 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:09.318760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b598-8659-45c7-9418-0e9265297f82 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:09.322721 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:09.323374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:09.323544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:09.323722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:09.323938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:09.324841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:09.325340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:09.325831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] PATH_INFO: `/v3/users/2b716212224140038d211a75a5ee709f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:09.328108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b716212224140038d211a75a5ee709f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:09.331516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:09.334802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:09.336314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:09.346147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1096/2221] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:09 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:29:09.554427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b716212224140038d211a75a5ee709f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:09.629532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b716212224140038d211a75a5ee709f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:09.642458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b716212224140038d211a75a5ee709f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:09.648950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b716212224140038d211a75a5ee709f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:09.649644 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f9ea21f5-af4f-4aad-963e-993084f81ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b716212224140038d211a75a5ee709f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:09.655448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1126/2222] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:09 2021] DELETE /identity/v3/users/2b716212224140038d211a75a5ee709f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:09.913666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:09.929964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b5f0-d364-4c00-87b9-396d0aa0a7d7 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:09.985399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:09.986237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:09.986525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:09.986803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] PATH_INFO: `/v3/projects/bd44df5f1089478c95dab66f0244a84d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:09.987976 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd44df5f1089478c95dab66f0244a84d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:09.989901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.159536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd44df5f1089478c95dab66f0244a84d', 'request_id': 'req-e59a47fe-39ad-4031-837f-d8e9da6494da'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:10.165486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd44df5f1089478c95dab66f0244a84d', 'request_id': 'req-e59a47fe-39ad-4031-837f-d8e9da6494da'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:10.171964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd44df5f1089478c95dab66f0244a84d', 'request_id': 'req-e59a47fe-39ad-4031-837f-d8e9da6494da'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:10.260649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] The token cache is being invalidate because project bd44df5f1089478c95dab66f0244a84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:10.260968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:10.261591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e59a47fe-39ad-4031-837f-d8e9da6494da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:10.264525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1097/2223] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:09 2021] DELETE /identity/v3/projects/bd44df5f1089478c95dab66f0244a84d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:10.269521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.269825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.270106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.288397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:10.290485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:10.348394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1127/2224] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:10.356785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.357078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.357363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.375052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:10.376236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:10.384215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1098/2225] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:10.388265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:10.398129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c7a04-27de-410a-bfeb-fac02c196a25 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:10.402635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:10.403515 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.403936 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.404246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.404997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:10.405306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:10.406871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.418668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1128/2226] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:10.422793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:10.431727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d4583-f1e6-4494-aa79-db3945d07db6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:10.436346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:10.437016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.437316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.437579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.438254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:10.440133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.525647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1099/2227] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:10 2021] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:10.529909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:10.540397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522136f-b817-4437-b7fd-f9448106499c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:10.593297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:10.593961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.594248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.594527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.595243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:10.597226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.695606 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1129/2228] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:10 2021] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:10.699445 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:10.710060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84462e92-14f9-4b34-a2a8-10152ffd33d5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:10.714820 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:10.715474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.715761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.716038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.716851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:10.718425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.729075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1100/2229] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:10.733046 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:10.742907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566ab3-6e1b-4596-865a-d29547ef5e44 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:10.747585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3918ed-ae36-4995-b7ad-d3e10c544847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:10.748194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3918ed-ae36-4995-b7ad-d3e10c544847 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.748520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3918ed-ae36-4995-b7ad-d3e10c544847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.748798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3918ed-ae36-4995-b7ad-d3e10c544847 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.749516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3918ed-ae36-4995-b7ad-d3e10c544847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:10.751117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3918ed-ae36-4995-b7ad-d3e10c544847 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.761313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1130/2230] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:10.765332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:10.775655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00442c2-7f58-456d-9848-50f2b3ebed96 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:10.780214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:10.781110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.781392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.781680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] PATH_INFO: `/v3/projects/06ce3fc3e8f94132bbefc94210aa5514/users/3ab49da608f94f61bdec3024c481c384/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.796978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ce3fc3e8f94132bbefc94210aa5514, user_id=3ab49da608f94f61bdec3024c481c384, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:10.801642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:10.913126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1101/2231] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:10 2021] PUT /identity/v3/projects/06ce3fc3e8f94132bbefc94210aa5514/users/3ab49da608f94f61bdec3024c481c384/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:10.918199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c027e-ab4d-4b7d-9271-ca3167e3df55 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:10.918501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c027e-ab4d-4b7d-9271-ca3167e3df55 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:10.918812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c027e-ab4d-4b7d-9271-ca3167e3df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:10.937483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ee2c027e-ab4d-4b7d-9271-ca3167e3df55 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:10.938370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ee2c027e-ab4d-4b7d-9271-ca3167e3df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:10.999941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1131/2232] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:11.010465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:11.012274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:11.068967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d5017-5baa-48e2-b047-e279bd4c6041 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:11.072884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:11.073613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:11.073832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:11.074217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:11.083435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:11.085469 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:11.095690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1102/2233] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:29:12.403742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:12.404281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:12.404281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:12.429721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] MFA Rules not processed for user `3ab49da608f94f61bdec3024c481c384`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:12.430911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:12.497484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1132/2234] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:12 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:12.502094 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:12.512435 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7bb0-e30d-4de9-bcab-bc074325f2ef service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:12.517510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:12.518254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:12.518548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:12.518852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:12.519543 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:12.522099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:12.641799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1103/2235] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:12 2021] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:12.645836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:12.656214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345408f8-a481-4353-b3eb-262ad72fd004 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:12.708059 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:12.708790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:12.709081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:12.709358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:12.710033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:12.711910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:12.883078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1133/2236] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:12 2021] POST /identity/v3/users => generated 308 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:12.889917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:12.900346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e7ea-ed41-413f-a58b-3d2868fb544b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:12.904943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:12.905722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:12.906185 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:12.906551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:12.907398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:12.909200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:12.919649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1104/2237] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:12.923863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:12.934076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f6c38-e3f8-4324-b3d2-da609e35afef admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:12.938747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:12.939647 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:12.939932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:12.940216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] PATH_INFO: `/v3/projects/29b925490c474535b1b3dcfc90a0c6a8/users/5eb3767bc46547878d1101bc7b852ac7/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:12.955216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b925490c474535b1b3dcfc90a0c6a8, user_id=5eb3767bc46547878d1101bc7b852ac7, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:12.957865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:13.032381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1134/2238] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:12 2021] PUT /identity/v3/projects/29b925490c474535b1b3dcfc90a0c6a8/users/5eb3767bc46547878d1101bc7b852ac7/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:13.036529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:13.046703 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a002b-b70f-41da-894d-95e5816744c3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:13.102175 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407dee9-c02a-438b-aaa0-17791330f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:13.102853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407dee9-c02a-438b-aaa0-17791330f91a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:13.103139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407dee9-c02a-438b-aaa0-17791330f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:13.103415 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407dee9-c02a-438b-aaa0-17791330f91a admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:13.104134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407dee9-c02a-438b-aaa0-17791330f91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:13.106045 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407dee9-c02a-438b-aaa0-17791330f91a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:13.116486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1105/2239] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:13 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:13.120907 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:13.131442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856fd34-a66d-49c6-9b62-c4d93db1102e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:13.136303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:13.137238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:13.137549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:13.137801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] PATH_INFO: `/v3/projects/29b925490c474535b1b3dcfc90a0c6a8/users/5eb3767bc46547878d1101bc7b852ac7/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:13.139728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b925490c474535b1b3dcfc90a0c6a8, user_id=5eb3767bc46547878d1101bc7b852ac7, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:13.142479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:13.153643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1135/2240] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:13 2021] PUT /identity/v3/projects/29b925490c474535b1b3dcfc90a0c6a8/users/5eb3767bc46547878d1101bc7b852ac7/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:14.384156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:14.384679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:14.384824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:14.411846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] MFA Rules not processed for user `5eb3767bc46547878d1101bc7b852ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:14.413165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:14.485396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1106/2241] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:14 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:15.825865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:15.886666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e22aa-0122-4011-93db-e8f8993d1dbc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:15.891364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:15.892235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:15.892557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:15.892836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] PATH_INFO: `/v3/users/3ab49da608f94f61bdec3024c481c384` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:15.894030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab49da608f94f61bdec3024c481c384)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:15.895948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:16.065789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab49da608f94f61bdec3024c481c384'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.163828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab49da608f94f61bdec3024c481c384'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.175861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab49da608f94f61bdec3024c481c384'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.182951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab49da608f94f61bdec3024c481c384'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.183574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab49da608f94f61bdec3024c481c384'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.189393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1136/2242] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:15 2021] DELETE /identity/v3/users/3ab49da608f94f61bdec3024c481c384 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:16.456377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:16.465379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414f08c-4abb-4831-8569-c50a7e56554c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:16.519662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:16.520560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:16.520865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:16.521607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] PATH_INFO: `/v3/projects/06ce3fc3e8f94132bbefc94210aa5514` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:16.522765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ce3fc3e8f94132bbefc94210aa5514)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:16.524704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:16.619246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ce3fc3e8f94132bbefc94210aa5514', 'request_id': 'req-6da82275-fbdc-4898-98f6-329854fcf51e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.624745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ce3fc3e8f94132bbefc94210aa5514', 'request_id': 'req-6da82275-fbdc-4898-98f6-329854fcf51e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.630849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ce3fc3e8f94132bbefc94210aa5514', 'request_id': 'req-6da82275-fbdc-4898-98f6-329854fcf51e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.707931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] The token cache is being invalidate because project 06ce3fc3e8f94132bbefc94210aa5514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:16.708156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.709284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:16.710796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1107/2243] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:16 2021] DELETE /identity/v3/projects/06ce3fc3e8f94132bbefc94210aa5514 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:16.714909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:16.716347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:16.730505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd822-11c6-464d-8635-f4072b6231b9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:16.786652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:16.787547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:16.787820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:16.788078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] PATH_INFO: `/v3/users/5eb3767bc46547878d1101bc7b852ac7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:16.789319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb3767bc46547878d1101bc7b852ac7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:16.791220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:16.993258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb3767bc46547878d1101bc7b852ac7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.040846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb3767bc46547878d1101bc7b852ac7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.053092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb3767bc46547878d1101bc7b852ac7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.059698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb3767bc46547878d1101bc7b852ac7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.060465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9cdce132-de43-4088-b808-6a3b6a2d6beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb3767bc46547878d1101bc7b852ac7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.066414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1137/2244] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:16 2021] DELETE /identity/v3/users/5eb3767bc46547878d1101bc7b852ac7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:17.314825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:17.316440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:17.329400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82275-fbdc-4898-98f6-329854fcf51e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:17.384100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:17.385007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:17.385290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:17.385566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] PATH_INFO: `/v3/projects/29b925490c474535b1b3dcfc90a0c6a8` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:17.386729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b925490c474535b1b3dcfc90a0c6a8)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:17.388650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:17.497949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b925490c474535b1b3dcfc90a0c6a8', 'request_id': 'req-02e55042-2aae-47e8-9add-2beed11f1655'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.503200 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b925490c474535b1b3dcfc90a0c6a8', 'request_id': 'req-02e55042-2aae-47e8-9add-2beed11f1655'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.509255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b925490c474535b1b3dcfc90a0c6a8', 'request_id': 'req-02e55042-2aae-47e8-9add-2beed11f1655'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.621191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] The token cache is being invalidate because project 29b925490c474535b1b3dcfc90a0c6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:17.621481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.622106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-02e55042-2aae-47e8-9add-2beed11f1655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:17.623642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1108/2245] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:17 2021] DELETE /identity/v3/projects/29b925490c474535b1b3dcfc90a0c6a8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:17.629485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:17.629782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:17.630065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:17.647308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:17.648579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:17.704750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1138/2246] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:17.712358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:17.712684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:17.712968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:17.731775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:17.732996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:17.741386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1109/2247] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:17.745697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:17.755174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a063dfc-b255-41b6-acd9-833efed62239 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:17.759779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:17.760442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:17.760746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:17.761020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:17.761840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:17.762155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:17.763727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:17.775018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1139/2248] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:29:17.779284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:17.789042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394c07-49e5-4948-a584-fd5c12b2aed6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:17.793837 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:17.794487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:17.794775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:17.795077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:17.795741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:17.797698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:17.890050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1110/2249] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:17 2021] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:17.894275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:17.904751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03cb5-2cca-4760-a718-772aab2a3c9e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:17.960142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:17.960847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:17.961139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:17.961421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:17.962117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:17.964082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.047610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1140/2250] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:17 2021] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:18.051859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.063518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683d7a-ae89-4b38-bd54-1d44d327a275 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.072050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.072847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.073136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.073417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.074157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.075770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.090242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1111/2251] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:18.091350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.106270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4d732-11f9-44d3-a938-461e134420f2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.111160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.111834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.112123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.112449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.113192 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.114850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.125443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1141/2252] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:18.129552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.139434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209252f8-17ba-4ae1-882d-0ea99329e037 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.144692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b704952-3497-4fa0-94b8-efc76f4eb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.145688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704952-3497-4fa0-94b8-efc76f4eb064 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.145964 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704952-3497-4fa0-94b8-efc76f4eb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.147007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704952-3497-4fa0-94b8-efc76f4eb064 admin admin] PATH_INFO: `/v3/projects/f8b0f1bf7b34432392cbdd4e03417b45/users/188a67f2d1c041278977997669a45c7f/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.165135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b704952-3497-4fa0-94b8-efc76f4eb064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b0f1bf7b34432392cbdd4e03417b45, user_id=188a67f2d1c041278977997669a45c7f, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.167759 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b704952-3497-4fa0-94b8-efc76f4eb064 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.211711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.213530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:18.269198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5d362-f74a-4232-acaa-2dbe4f21c30d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.273474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.274150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.274436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.274718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.276525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:18.284514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1112/2253] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:18 2021] PUT /identity/v3/projects/f8b0f1bf7b34432392cbdd4e03417b45/users/188a67f2d1c041278977997669a45c7f/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:18.293829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.294247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.294537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.324477 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] MFA Rules not processed for user `188a67f2d1c041278977997669a45c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:18.325710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:18.341095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.342623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.353145 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1142/2254] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:18 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:29:18.400922 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1113/2255] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:18 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:18.405480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.415803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1003de6-04f5-439a-8e92-6999611d8459 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.470345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.471013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.471296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.471575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.472301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.474248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.577700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1143/2256] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:18 2021] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:18.581766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.593011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a126f81-c9b9-443b-8dec-8de937f61a6a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.649996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.657627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.657933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.658193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.658890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.660936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.748290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1114/2257] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:18 2021] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:18.753024 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.768056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881496-9058-490f-a55e-171fb2c293cb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.773471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.774204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.774552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.774964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.775860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.777662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.789452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1144/2258] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:18.793272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.803567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e272c8-51ac-44dc-9dd3-83f5285b7061 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:18.808551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:18.809484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:18.809771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:18.810047 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] PATH_INFO: `/v3/projects/1a594545331144d0b3893b3567b8b3b7/users/e3ca204d58c743a59f8c44160cb42920/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:18.826268 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a594545331144d0b3893b3567b8b3b7, user_id=e3ca204d58c743a59f8c44160cb42920, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:18.829279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:18.964103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1115/2259] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:18 2021] PUT /identity/v3/projects/1a594545331144d0b3893b3567b8b3b7/users/e3ca204d58c743a59f8c44160cb42920/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:18.968125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:18.978262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3293-5165-4890-95e1-0c86810d5974 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:19.034274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07fba-6b80-4890-8bc6-6af441f23ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:19.035032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07fba-6b80-4890-8bc6-6af441f23ddc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.035402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07fba-6b80-4890-8bc6-6af441f23ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.035756 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07fba-6b80-4890-8bc6-6af441f23ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.037252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07fba-6b80-4890-8bc6-6af441f23ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:19.038982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07fba-6b80-4890-8bc6-6af441f23ddc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:19.049652 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1145/2260] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:19.054399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:19.065059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775dfbd-d822-4afe-8793-81ec8008a145 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:19.070217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:19.071187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.071505 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.071782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] PATH_INFO: `/v3/projects/1a594545331144d0b3893b3567b8b3b7/users/e3ca204d58c743a59f8c44160cb42920/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.073821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a594545331144d0b3893b3567b8b3b7, user_id=e3ca204d58c743a59f8c44160cb42920, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:19.076492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:19.088517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1116/2261] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:19 2021] PUT /identity/v3/projects/1a594545331144d0b3893b3567b8b3b7/users/e3ca204d58c743a59f8c44160cb42920/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:19.098685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.099056 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.099956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.128201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] MFA Rules not processed for user `e3ca204d58c743a59f8c44160cb42920`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:19.129488 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:19.204181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1146/2262] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:19 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:19.215382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:19.217647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:19.285297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd35de-dfdd-419e-84c6-ef772e4fb49b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:19.289636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:19.290320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.290599 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.290873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.300141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:19.301597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:19.311802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1117/2263] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:19 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:19.408171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:19.409639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:19.470692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08b2f7-1ff4-4389-976d-9c604f749be3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:19.475892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:19.476811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.477099 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.477374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] PATH_INFO: `/v3/users/df959c548162491da82a5a8c6dd75470` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.478583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=df959c548162491da82a5a8c6dd75470)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:19.480787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:19.640958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:19.649742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a19b7-65d4-4df4-9ba4-d698966f2cb1 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:19.653429 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4c6df-c973-49dd-8a16-da28234064a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:19.654065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4c6df-c973-49dd-8a16-da28234064a5 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.654354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4c6df-c973-49dd-8a16-da28234064a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.654617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4c6df-c973-49dd-8a16-da28234064a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.683815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df959c548162491da82a5a8c6dd75470'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:19.714121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4c6df-c973-49dd-8a16-da28234064a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:19.715540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4c6df-c973-49dd-8a16-da28234064a5 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:19.725127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1118/2264] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:19 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:29:19.764150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df959c548162491da82a5a8c6dd75470'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:19.777317 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df959c548162491da82a5a8c6dd75470'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:19.783862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df959c548162491da82a5a8c6dd75470'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:19.784547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df959c548162491da82a5a8c6dd75470'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:19.790344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1147/2265] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:19 2021] DELETE /identity/v3/users/df959c548162491da82a5a8c6dd75470 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:19.794837 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.795133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.795410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.813311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:19.814510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:19.873717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1119/2266] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:19.915312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:19.916739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:19.974680 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308a44-16e8-4ede-b18d-3e49d2f1afbf admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:19.978534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673984ab-8844-4aa6-bc4b-f16210b1ac20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:19.979198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673984ab-8844-4aa6-bc4b-f16210b1ac20 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:19.979502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673984ab-8844-4aa6-bc4b-f16210b1ac20 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:19.979783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673984ab-8844-4aa6-bc4b-f16210b1ac20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:19.989342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673984ab-8844-4aa6-bc4b-f16210b1ac20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:19.990771 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673984ab-8844-4aa6-bc4b-f16210b1ac20 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:20.000091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1148/2267] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:20.691122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:20.693174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:20.710379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679132c-544e-46cb-8c63-9df5e03f8b5c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:20.716226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:20.719049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:20.719389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:20.720600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] PATH_INFO: `/v3/projects/52c18737ebe84736883ae086f852a5ca` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:20.722122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c18737ebe84736883ae086f852a5ca)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:20.725587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:20.931908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c18737ebe84736883ae086f852a5ca', 'request_id': 'req-64b6f820-84b1-41f2-9715-d85f3c14166f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:20.938408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c18737ebe84736883ae086f852a5ca', 'request_id': 'req-64b6f820-84b1-41f2-9715-d85f3c14166f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:20.946514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c18737ebe84736883ae086f852a5ca', 'request_id': 'req-64b6f820-84b1-41f2-9715-d85f3c14166f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:21.045349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] The token cache is being invalidate because project 52c18737ebe84736883ae086f852a5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:21.046032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:21.046947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-64b6f820-84b1-41f2-9715-d85f3c14166f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:21.049055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1120/2268] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:20 2021] DELETE /identity/v3/projects/52c18737ebe84736883ae086f852a5ca => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:21.054800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.055340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.055340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.075813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:21.077384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:21.151416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1149/2269] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:21.154132 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.154651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.155032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.175313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:21.177117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:21.189778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1121/2270] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:21.190782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:21.203531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2bbcd-3f3c-4680-b995-0763d097dc94 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:21.222474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:21.223517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.225062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.225529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.226713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:21.227193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:21.229177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:21.242820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1150/2271] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:21.247619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:21.266007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e638dd-1657-4a1a-a796-ea28400e2385 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:21.271736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:21.272403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.272735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.273147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.273887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:21.275948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:21.378894 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1122/2272] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:21 2021] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:21.386435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:21.399136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb58c9-5fa7-4914-b003-c154c1d4e81a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:21.469442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:21.469442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.469442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.469442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.469779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:21.469779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:21.587809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1151/2273] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:21 2021] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:21.591932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:21.603518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec60d-fae7-4119-b6d9-6b4f5b84aaf6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:21.608982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:21.613719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.613719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.613719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.614441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:21.616835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:21.628404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1123/2274] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:21.633865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:21.645574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e759ec-7712-4d9b-b0f8-83e441d54c18 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:21.650735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799c2bd-460c-4168-86c0-6ecd6eff2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:21.651475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c2bd-460c-4168-86c0-6ecd6eff2d2f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.651769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c2bd-460c-4168-86c0-6ecd6eff2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.652054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c2bd-460c-4168-86c0-6ecd6eff2d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.652835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799c2bd-460c-4168-86c0-6ecd6eff2d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:21.654851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799c2bd-460c-4168-86c0-6ecd6eff2d2f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:21.666758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1152/2275] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:21.670665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:21.681858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17188b4-d0b0-43f5-89a6-33f329c081dc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:21.693941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:21.693941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.693941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.693941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] PATH_INFO: `/v3/projects/6e9cf9b4e684441f9750e56e94dc1e0d/users/13cd39f2af03415aa0b9db008a90ce4b/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.716631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9cf9b4e684441f9750e56e94dc1e0d, user_id=13cd39f2af03415aa0b9db008a90ce4b, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:21.719379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:21.799078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1124/2276] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:21 2021] PUT /identity/v3/projects/6e9cf9b4e684441f9750e56e94dc1e0d/users/13cd39f2af03415aa0b9db008a90ce4b/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:21.810165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:21.810477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:21.810766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:21.854617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] MFA Rules not processed for user `13cd39f2af03415aa0b9db008a90ce4b`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:21.856219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:21.929811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1153/2277] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:21 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:21.934068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.030029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ddc5b-2afe-4102-b084-2a221be7c698 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.036095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.037630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.038136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.038715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.039451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.041602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.194612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1125/2278] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:21 2021] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:22.198740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.210289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9402-1847-40ac-8eaf-453e3027a1ce None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.280674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.280674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.280674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.280674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.281070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.281070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.377969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1154/2279] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:22 2021] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:22.382151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.392215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeeba80-05af-41f8-8dd4-8a02d91514d2 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.397422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.398057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.398337 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.398608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.399381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.400974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.411540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1126/2280] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:22.416659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.426517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1ba1b-c646-4862-91ad-f6ad81017310 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.431193 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.432069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.432381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.432701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] PATH_INFO: `/v3/projects/6810428890ff4de69407616f23603757/users/1221122e8b3c491d829620b9f917beef/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.447039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6810428890ff4de69407616f23603757, user_id=1221122e8b3c491d829620b9f917beef, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.449793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.561116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1155/2281] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:22 2021] PUT /identity/v3/projects/6810428890ff4de69407616f23603757/users/1221122e8b3c491d829620b9f917beef/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:22.565269 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.575389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871f66f-9dc0-4136-9314-2364f05d66f6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.631999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1242c-b7c6-4208-90b9-88e9a8c09284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.632700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1242c-b7c6-4208-90b9-88e9a8c09284 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.632987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1242c-b7c6-4208-90b9-88e9a8c09284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.637296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1242c-b7c6-4208-90b9-88e9a8c09284 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.637296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1242c-b7c6-4208-90b9-88e9a8c09284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.637296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1242c-b7c6-4208-90b9-88e9a8c09284 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.645240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1127/2282] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:22.649961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.660138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe6c23-629e-4d4e-99f6-b5c03eebe28a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.665419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.666282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.666561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.666832 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] PATH_INFO: `/v3/projects/6810428890ff4de69407616f23603757/users/1221122e8b3c491d829620b9f917beef/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.668896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6810428890ff4de69407616f23603757, user_id=1221122e8b3c491d829620b9f917beef, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.671468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.681747 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1156/2283] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:22 2021] PUT /identity/v3/projects/6810428890ff4de69407616f23603757/users/1221122e8b3c491d829620b9f917beef/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:22.691663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.691966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.692256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.719302 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] MFA Rules not processed for user `1221122e8b3c491d829620b9f917beef`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:22.720449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:22.786899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1128/2284] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:22 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:22.797475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.799146 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:22.852748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0a98-ca10-481d-80e0-101b8e64bb58 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.856843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b233d-0fa4-443b-8c14-b7586a350c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.857499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b233d-0fa4-443b-8c14-b7586a350c80 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.857786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b233d-0fa4-443b-8c14-b7586a350c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.858072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b233d-0fa4-443b-8c14-b7586a350c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.866948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b233d-0fa4-443b-8c14-b7586a350c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.868360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b233d-0fa4-443b-8c14-b7586a350c80 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:22.877809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1157/2285] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:22 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:22.904862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:22.963782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe74c-5471-4324-b02d-0132b23d8fc2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:22.968493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:22.969409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:22.969633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:22.969908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] PATH_INFO: `/v3/users/13cd39f2af03415aa0b9db008a90ce4b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:22.971098 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cd39f2af03415aa0b9db008a90ce4b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:22.973019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:23.113904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cd39f2af03415aa0b9db008a90ce4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:23.114565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cd39f2af03415aa0b9db008a90ce4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:23.115707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cd39f2af03415aa0b9db008a90ce4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:23.186784 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cd39f2af03415aa0b9db008a90ce4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:23.199879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cd39f2af03415aa0b9db008a90ce4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:23.212352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1129/2286] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:22 2021] DELETE /identity/v3/users/13cd39f2af03415aa0b9db008a90ce4b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:23.216793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:23.217615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:23.217899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:23.236263 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:23.237751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:23.295230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1158/2287] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:23.305605 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:23.307112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:23.373202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38862f-4199-4482-81ea-6f3024ada36a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:23.378513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:23.379158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:23.383127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:23.383127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:23.390226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:23.391650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:23.401093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1130/2288] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:23.917475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:23.918896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:23.930654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428294-42e4-4bcb-b985-cc8885a785a8 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:23.935309 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:23.936166 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:23.936489 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:23.936768 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] PATH_INFO: `/v3/projects/6e9cf9b4e684441f9750e56e94dc1e0d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:23.938163 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9cf9b4e684441f9750e56e94dc1e0d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:23.942746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:24.035997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9cf9b4e684441f9750e56e94dc1e0d', 'request_id': 'req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.041896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9cf9b4e684441f9750e56e94dc1e0d', 'request_id': 'req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.047969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9cf9b4e684441f9750e56e94dc1e0d', 'request_id': 'req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.097300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] The token cache is being invalidate because project 6e9cf9b4e684441f9750e56e94dc1e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:24.101135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.101135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.101135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1159/2289] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:23 2021] DELETE /identity/v3/projects/6e9cf9b4e684441f9750e56e94dc1e0d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:24.104571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:24.114736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b3877-7e7d-41d9-a0e7-207b9dcb8271 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:24.170144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:24.180666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:24.180666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:24.180666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] PATH_INFO: `/v3/users/1221122e8b3c491d829620b9f917beef` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:24.180666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1221122e8b3c491d829620b9f917beef)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:24.180666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:24.370743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1221122e8b3c491d829620b9f917beef'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.371393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1221122e8b3c491d829620b9f917beef'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.372005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1221122e8b3c491d829620b9f917beef'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.432221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1221122e8b3c491d829620b9f917beef'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.444300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91bbe0d0-c40e-4e5e-9051-f46173862063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1221122e8b3c491d829620b9f917beef'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:24.456010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1131/2290] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:24 2021] DELETE /identity/v3/users/1221122e8b3c491d829620b9f917beef => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:24.871525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:24.874016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:24.888358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb75d-1aeb-4aa4-b74f-5772baf1a5b0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:24.945465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:24.946381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:24.946674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:24.946951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] PATH_INFO: `/v3/projects/6810428890ff4de69407616f23603757` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:24.948156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6810428890ff4de69407616f23603757)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:24.950122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.057545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6810428890ff4de69407616f23603757', 'request_id': 'req-b47617b9-aab2-4c3c-9b2d-b99af3335125'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:25.062870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6810428890ff4de69407616f23603757', 'request_id': 'req-b47617b9-aab2-4c3c-9b2d-b99af3335125'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:25.069041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6810428890ff4de69407616f23603757', 'request_id': 'req-b47617b9-aab2-4c3c-9b2d-b99af3335125'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:25.139792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] The token cache is being invalidate because project 6810428890ff4de69407616f23603757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:25.140016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:25.140664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b47617b9-aab2-4c3c-9b2d-b99af3335125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:25.142261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1160/2291] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:24 2021] DELETE /identity/v3/projects/6810428890ff4de69407616f23603757 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:25.147992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.148506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.148619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.166507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:25.167695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:25.222949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1132/2292] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:25.232693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.233065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.233424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.252739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:25.253933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:25.263318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1161/2293] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:25.267334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:25.277240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3c99d-f793-45d5-b0f1-773428b74bb8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:25.281825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:25.282476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.282758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.283034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.283750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:25.284056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:25.285659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.297701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1133/2294] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:25.302152 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:25.311901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbafbf-89b4-495f-bfe4-0f549386a54b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:25.316969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:25.317638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.317960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.318243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.318941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:25.320883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.410633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1162/2295] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:25 2021] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:25.415317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:25.425061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca3f1-4a62-4c5d-9212-a2a3f0cdf5bc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:25.482733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:25.483401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.483685 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.483961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.484680 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:25.486578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.643967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1134/2296] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:25 2021] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:25.648634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:25.658595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf0a55-5946-4fd0-b7d4-abfddf6332a5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:25.663810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:25.664410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.664723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.665005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.665743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:25.667315 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.677469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1163/2297] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:25.681127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:25.690688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdcd2d-2cac-4be3-a123-75012c3a7458 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:25.695238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59f7c2-3198-4938-9935-ee9e7c1ab03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:25.695882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59f7c2-3198-4938-9935-ee9e7c1ab03d admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.696204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59f7c2-3198-4938-9935-ee9e7c1ab03d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.696515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59f7c2-3198-4938-9935-ee9e7c1ab03d admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.697226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59f7c2-3198-4938-9935-ee9e7c1ab03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:25.698889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59f7c2-3198-4938-9935-ee9e7c1ab03d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.709095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1135/2298] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:25 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:25.713139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:25.722693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b186-2f4b-421e-8be7-7b951083f89f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:25.727784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:25.728678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.728966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.729241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] PATH_INFO: `/v3/projects/03e8e65f752240ecb41d13cd9a399a39/users/c1375ae3072e4c3091311c0aaffbf70a/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.743258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e8e65f752240ecb41d13cd9a399a39, user_id=c1375ae3072e4c3091311c0aaffbf70a, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:25.745968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:25.846512 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1164/2299] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:25 2021] PUT /identity/v3/projects/03e8e65f752240ecb41d13cd9a399a39/users/c1375ae3072e4c3091311c0aaffbf70a/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:25.857025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:25.857317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:25.862317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:25.883112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] MFA Rules not processed for user `c1375ae3072e4c3091311c0aaffbf70a`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:25.884300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:25.944192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1136/2300] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:25 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:25.948575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.008743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe181ba-a488-40a1-aec9-8d7e5a76efec admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.013448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.014110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.014399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.014681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.015388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.017301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.114180 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1165/2301] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:25 2021] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:26.115982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.127409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5c867-4ad9-42dc-82a2-021da03ef483 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.180069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.180764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.181048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.181324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.182004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.183897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.292704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1137/2302] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:26 2021] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:26.296438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.306869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084d8c-b85d-43a6-b197-be620c3d6fb7 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.312536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.312536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.312536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.312844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.313438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.315000 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.328723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1166/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:26.329790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.339537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d08d4-9765-4d80-86ce-459141f0376d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.344289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.345104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.345390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.345672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] PATH_INFO: `/v3/projects/0a2ced418714453bb6f014009dd36be3/users/c39e0db2f7c74cc9a5b61d1a97c1cfb4/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.360857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2ced418714453bb6f014009dd36be3, user_id=c39e0db2f7c74cc9a5b61d1a97c1cfb4, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.363444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.444725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1138/2304] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:26 2021] PUT /identity/v3/projects/0a2ced418714453bb6f014009dd36be3/users/c39e0db2f7c74cc9a5b61d1a97c1cfb4/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:26.448650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.458245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4896-ec90-4c42-9b1e-2bd207476f96 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.511999 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf58fb-d00b-4a3b-8cc2-9ca35a61511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.512632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf58fb-d00b-4a3b-8cc2-9ca35a61511b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.512915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf58fb-d00b-4a3b-8cc2-9ca35a61511b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.513190 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf58fb-d00b-4a3b-8cc2-9ca35a61511b admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.513900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf58fb-d00b-4a3b-8cc2-9ca35a61511b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.515457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf58fb-d00b-4a3b-8cc2-9ca35a61511b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.533338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1167/2305] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:26 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:26.537934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.547930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44145-747a-4760-9210-f41a67ad4d23 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.553261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.554160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.554440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.554712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] PATH_INFO: `/v3/projects/0a2ced418714453bb6f014009dd36be3/users/c39e0db2f7c74cc9a5b61d1a97c1cfb4/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.556679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2ced418714453bb6f014009dd36be3, user_id=c39e0db2f7c74cc9a5b61d1a97c1cfb4, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.559298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.569365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1139/2306] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:26 2021] PUT /identity/v3/projects/0a2ced418714453bb6f014009dd36be3/users/c39e0db2f7c74cc9a5b61d1a97c1cfb4/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:26.581780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.582071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.582347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.608930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] MFA Rules not processed for user `c39e0db2f7c74cc9a5b61d1a97c1cfb4`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:26.610126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:26.674933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1168/2307] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:26 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:26.685773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.687402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:26.742442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff1474-43ad-4e46-be0d-6a39ac03334d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.746113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdd927-7d1a-4140-baef-63bfdea30f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.746765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdd927-7d1a-4140-baef-63bfdea30f66 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.747027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdd927-7d1a-4140-baef-63bfdea30f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.747298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdd927-7d1a-4140-baef-63bfdea30f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.755961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdd927-7d1a-4140-baef-63bfdea30f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.757401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdd927-7d1a-4140-baef-63bfdea30f66 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:26.766529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1140/2308] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:26 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:26.882409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:26.940110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51782da9-019b-424c-8567-372eaea9d1eb None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:26.944847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:26.945707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:26.945998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:26.946280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] PATH_INFO: `/v3/users/c1375ae3072e4c3091311c0aaffbf70a` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:26.947460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1375ae3072e4c3091311c0aaffbf70a)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:26.949398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:27.142834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1375ae3072e4c3091311c0aaffbf70a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.210359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1375ae3072e4c3091311c0aaffbf70a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.222596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1375ae3072e4c3091311c0aaffbf70a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.230365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1375ae3072e4c3091311c0aaffbf70a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.231054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1375ae3072e4c3091311c0aaffbf70a'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.237255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1169/2309] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:26 2021] DELETE /identity/v3/users/c1375ae3072e4c3091311c0aaffbf70a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:27.241738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:27.242191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:27.242493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:27.260640 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:27.261827 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:27.318220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1141/2310] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:27.327983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:27.329380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:27.384305 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a43510-f793-4ec2-84f0-4871e6057dff admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:27.387998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:27.388676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:27.388962 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:27.389241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:27.398701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:27.400086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:27.409703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1170/2311] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:29:27.823217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:27.824802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:27.838276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547f7b7-2950-433c-9fda-b9ab8a15f96b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:27.843958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:27.845210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:27.845496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:27.853149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] PATH_INFO: `/v3/projects/03e8e65f752240ecb41d13cd9a399a39` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:27.853149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e8e65f752240ecb41d13cd9a399a39)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:27.853149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:27.986279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e8e65f752240ecb41d13cd9a399a39', 'request_id': 'req-45306d95-4ea4-48bc-a64c-b4eb07f8a883'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.992194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e8e65f752240ecb41d13cd9a399a39', 'request_id': 'req-45306d95-4ea4-48bc-a64c-b4eb07f8a883'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:27.998051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e8e65f752240ecb41d13cd9a399a39', 'request_id': 'req-45306d95-4ea4-48bc-a64c-b4eb07f8a883'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.073758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] The token cache is being invalidate because project 03e8e65f752240ecb41d13cd9a399a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:28.074050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.074701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.076241 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1142/2312] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:27 2021] DELETE /identity/v3/projects/03e8e65f752240ecb41d13cd9a399a39 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:28.080261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:28.089948 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1184de-38a7-4cf7-9184-f83f26bff0e7 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:28.144131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:28.145022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:28.145307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:28.145583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] PATH_INFO: `/v3/users/c39e0db2f7c74cc9a5b61d1a97c1cfb4` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:28.146753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39e0db2f7c74cc9a5b61d1a97c1cfb4)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:28.148679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:28.331577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39e0db2f7c74cc9a5b61d1a97c1cfb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.400822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39e0db2f7c74cc9a5b61d1a97c1cfb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.413776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39e0db2f7c74cc9a5b61d1a97c1cfb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.420750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39e0db2f7c74cc9a5b61d1a97c1cfb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.421454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-ffb0d780-6474-45b3-8139-126d97d2e0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39e0db2f7c74cc9a5b61d1a97c1cfb4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:28.427553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1171/2313] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:28 2021] DELETE /identity/v3/users/c39e0db2f7c74cc9a5b61d1a97c1cfb4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:28.900160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:28.901643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:28.915379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45306d95-4ea4-48bc-a64c-b4eb07f8a883 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:28.974545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:28.975407 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:28.975688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:28.975962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] PATH_INFO: `/v3/projects/0a2ced418714453bb6f014009dd36be3` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:28.977168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2ced418714453bb6f014009dd36be3)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:28.979058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.089159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2ced418714453bb6f014009dd36be3', 'request_id': 'req-fb3fedac-2e25-49a1-bba3-d11cf6249802'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:29.094305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2ced418714453bb6f014009dd36be3', 'request_id': 'req-fb3fedac-2e25-49a1-bba3-d11cf6249802'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:29.100724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2ced418714453bb6f014009dd36be3', 'request_id': 'req-fb3fedac-2e25-49a1-bba3-d11cf6249802'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:29.180480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] The token cache is being invalidate because project 0a2ced418714453bb6f014009dd36be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:29.180768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:29.181379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fb3fedac-2e25-49a1-bba3-d11cf6249802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:29.182902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1143/2314] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:28 2021] DELETE /identity/v3/projects/0a2ced418714453bb6f014009dd36be3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:29.188534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.188996 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.189089 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.206385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:29.207560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:29.265375 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1172/2315] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:29.274447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.274743 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.275031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.294238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:29.295455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:29.304006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1144/2316] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:29.308135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.317449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021192-e593-42c4-a1d8-022a07396171 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.322682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.323338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.323622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.323899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.324752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:29.325036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:29.326607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.337957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1173/2317] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:29.342532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.351882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37651-4ac2-4394-8841-2789c59e95e6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.357089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.357742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.358102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.358340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.359124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:29.361161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.453281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1145/2318] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:29 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:29.457549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.467578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39eed-af35-4da9-873c-318e9fde657d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.525421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.526103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.526394 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.526676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.527374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:29.529426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.622271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1174/2319] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:29 2021] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:29.625174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.635719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652dff4-1a22-4ef8-a875-906a777c41fc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.640365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.641056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.641340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.641618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.642447 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:29.644026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.654835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1146/2320] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:29.658699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.668395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800103e-41ca-4cfd-9c36-0afe264cdec1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.673967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0daa3c-361e-4b68-b426-9e4d5680d12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.673967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daa3c-361e-4b68-b426-9e4d5680d12d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.673967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daa3c-361e-4b68-b426-9e4d5680d12d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.674302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daa3c-361e-4b68-b426-9e4d5680d12d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.674805 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0daa3c-361e-4b68-b426-9e4d5680d12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:29.676445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0daa3c-361e-4b68-b426-9e4d5680d12d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.686221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1175/2321] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:29.690508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.701655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0a17-d2d5-4c1a-95f0-9412081c78e1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.706613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.707535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.707822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.708180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] PATH_INFO: `/v3/projects/be97feed3ef7425daa59e3477b3c0ca2/users/8f0e001c2de34ea999ded1fa3e8070ce/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.722546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be97feed3ef7425daa59e3477b3c0ca2, user_id=8f0e001c2de34ea999ded1fa3e8070ce, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:29.725376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:29.823747 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1147/2322] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:29 2021] PUT /identity/v3/projects/be97feed3ef7425daa59e3477b3c0ca2/users/8f0e001c2de34ea999ded1fa3e8070ce/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:29.834645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.834957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.835241 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:29.861825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] MFA Rules not processed for user `8f0e001c2de34ea999ded1fa3e8070ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:29.863011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:29.924586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1176/2323] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:29 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:29.935021 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:29.936801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:29.992346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fc67c-f1f4-49e9-ada3-2bc0a1f4bce6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:29.996060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7ce05-ec66-4595-9692-6227aa97300e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:29.996749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ce05-ec66-4595-9692-6227aa97300e service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:29.997033 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ce05-ec66-4595-9692-6227aa97300e service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:29.997315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ce05-ec66-4595-9692-6227aa97300e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:30.006020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7ce05-ec66-4595-9692-6227aa97300e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:30.007504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7ce05-ec66-4595-9692-6227aa97300e service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:30.016542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1148/2324] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:29 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:32.752052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:32.753449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:32.814047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df956212-5aec-4095-8b07-f9f6b343862d None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:32.818992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:32.819850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:32.820136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:32.820406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] PATH_INFO: `/v3/users/188a67f2d1c041278977997669a45c7f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:32.821619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188a67f2d1c041278977997669a45c7f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:32.823500 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:33.031666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188a67f2d1c041278977997669a45c7f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.121081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188a67f2d1c041278977997669a45c7f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.134118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188a67f2d1c041278977997669a45c7f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.140704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188a67f2d1c041278977997669a45c7f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.141346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188a67f2d1c041278977997669a45c7f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.147322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1177/2325] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:32 2021] DELETE /identity/v3/users/188a67f2d1c041278977997669a45c7f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:33.151713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:33.152175 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:33.152289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:33.169698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:33.170888 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:33.232963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1149/2326] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:33.243400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:33.244827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:33.298482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e78b7-2565-44a7-b1a7-15242c7bea33 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:33.302679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:33.303319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:33.303601 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:33.303874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:33.312468 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:33.313880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:33.323006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1178/2327] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:33.743010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:33.744496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:33.755968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f79630-f870-4856-97f4-3d1ea5c94086 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:33.761123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:33.762008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:33.762312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:33.762602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] PATH_INFO: `/v3/projects/f8b0f1bf7b34432392cbdd4e03417b45` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:33.763800 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b0f1bf7b34432392cbdd4e03417b45)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:33.765758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:33.868935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b0f1bf7b34432392cbdd4e03417b45', 'request_id': 'req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.874037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b0f1bf7b34432392cbdd4e03417b45', 'request_id': 'req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.879958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b0f1bf7b34432392cbdd4e03417b45', 'request_id': 'req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.953556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] The token cache is being invalidate because project f8b0f1bf7b34432392cbdd4e03417b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:33.953851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.954475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:33.956008 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1150/2328] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:33 2021] DELETE /identity/v3/projects/f8b0f1bf7b34432392cbdd4e03417b45 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:33.960476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:33.970112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675a49-50de-4012-b8f6-c4515f4072f0 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:34.024987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:34.025801 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:34.026086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:34.026364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] PATH_INFO: `/v3/users/e3ca204d58c743a59f8c44160cb42920` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:34.027539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ca204d58c743a59f8c44160cb42920)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:34.029535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:34.227637 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ca204d58c743a59f8c44160cb42920'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.320917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ca204d58c743a59f8c44160cb42920'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.333045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ca204d58c743a59f8c44160cb42920'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.340273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ca204d58c743a59f8c44160cb42920'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.340928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c533e880-9dd5-4c54-893a-f1071701c174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ca204d58c743a59f8c44160cb42920'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.346817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1179/2329] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:33 2021] DELETE /identity/v3/users/e3ca204d58c743a59f8c44160cb42920 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:34.756377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:34.757846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:34.770481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b676-ceac-44cb-b3b4-44c0c4ea855c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:34.824410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:34.825303 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:34.825637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:34.825869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] PATH_INFO: `/v3/projects/1a594545331144d0b3893b3567b8b3b7` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:34.827034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a594545331144d0b3893b3567b8b3b7)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:34.828991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:34.931750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a594545331144d0b3893b3567b8b3b7', 'request_id': 'req-c7ff54b5-8017-45d5-9044-5dc2010c1044'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.937060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a594545331144d0b3893b3567b8b3b7', 'request_id': 'req-c7ff54b5-8017-45d5-9044-5dc2010c1044'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:34.942875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a594545331144d0b3893b3567b8b3b7', 'request_id': 'req-c7ff54b5-8017-45d5-9044-5dc2010c1044'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:35.031019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] The token cache is being invalidate because project 1a594545331144d0b3893b3567b8b3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:35.031304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:35.031904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c7ff54b5-8017-45d5-9044-5dc2010c1044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:35.033427 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1151/2330] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:34 2021] DELETE /identity/v3/projects/1a594545331144d0b3893b3567b8b3b7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:35.039612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.040078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.040216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.057671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:35.058854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:35.114001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1180/2331] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:35.122462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.122754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.123040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.140806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:35.141988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:35.150265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1152/2332] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:35.154224 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.164051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad7ca-f9c8-4172-9229-8a2b54a565ae None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.168608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.169256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.169537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.169812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.170527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:35.170835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.172389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:35.183334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1181/2333] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:35.187438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.196316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dd0a5-5a0e-49ab-b749-63e9a7054515 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.200972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.201615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.201896 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.202173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.202870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.204775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:35.313901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1153/2334] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:35 2021] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:35.319038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.329661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a38b-229c-4abd-836a-dad802b7d2d3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.386243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.386921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.387234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.390658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.390658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.390658 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:35.481292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1182/2335] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:35 2021] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:35.485687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.495825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce980bb-e1bd-4167-89f1-4cc4482479ca admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.500387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.501112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.501393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.501673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.502421 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.503997 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:35.514872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1154/2336] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:35.521379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.532346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047624d-037d-4946-b477-c010c1898fcd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.537031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023b51c-2e60-46f9-aad1-7afe0b3889a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.537684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b51c-2e60-46f9-aad1-7afe0b3889a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.537969 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b51c-2e60-46f9-aad1-7afe0b3889a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.538245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b51c-2e60-46f9-aad1-7afe0b3889a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.538960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023b51c-2e60-46f9-aad1-7afe0b3889a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.540541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023b51c-2e60-46f9-aad1-7afe0b3889a1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:35.550122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1183/2337] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:35.555961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.565734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed123e9e-c368-4965-ae1c-4018adea1027 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.576100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.577021 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.577307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.577585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] PATH_INFO: `/v3/projects/059999df53af4843aa706d226f3eb431/users/b8e327a1bd7546eca8386375880f241a/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.593053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=059999df53af4843aa706d226f3eb431, user_id=b8e327a1bd7546eca8386375880f241a, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.595751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:35.726856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1155/2338] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:35 2021] PUT /identity/v3/projects/059999df53af4843aa706d226f3eb431/users/b8e327a1bd7546eca8386375880f241a/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:35.737289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.737607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.742124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.763357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] MFA Rules not processed for user `b8e327a1bd7546eca8386375880f241a`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:35.764576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:35.827353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1184/2339] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:35 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:35.831840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:35.891206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85785c2-624d-40ed-a5ff-295fa7563608 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:35.895783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:35.896455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:35.896745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:35.897026 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:35.897748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:35.899622 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.024170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1156/2340] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:35 2021] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:36.028179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.038552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608264c-2f29-4bbb-9511-c2b236dd74ce None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.091083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.091742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.092025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.092302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.093045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.094921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.206350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1185/2341] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:36 2021] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:36.210328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.220532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda5c4-db83-46f6-9e9b-baec8a7bbf33 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.225735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.226387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.226669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.226945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.227709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.229314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.239910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1157/2342] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:36.244812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.254511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41324e-505e-4191-b59d-00547a61f8cc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.259086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.259967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.260253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.260571 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] PATH_INFO: `/v3/projects/460e40bb6a3c4a9ebc3272e47e93f36c/users/f3532d40f13644a7babfd633e2a9636b/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.275392 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460e40bb6a3c4a9ebc3272e47e93f36c, user_id=f3532d40f13644a7babfd633e2a9636b, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.277971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.346882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1186/2343] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:36 2021] PUT /identity/v3/projects/460e40bb6a3c4a9ebc3272e47e93f36c/users/f3532d40f13644a7babfd633e2a9636b/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:36.351376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.361270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d2b47-08d4-4e2a-8f3f-eabad54f11eb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.415916 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26594d-815c-4906-902a-49bd06eaf176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.416621 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26594d-815c-4906-902a-49bd06eaf176 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.416907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26594d-815c-4906-902a-49bd06eaf176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.417186 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26594d-815c-4906-902a-49bd06eaf176 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.417910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26594d-815c-4906-902a-49bd06eaf176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.419603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26594d-815c-4906-902a-49bd06eaf176 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.430115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1158/2344] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:36.434462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.444698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0a7af-db1e-4577-99fd-cafa64e70cd8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.449448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.450336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.450642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.450917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] PATH_INFO: `/v3/projects/460e40bb6a3c4a9ebc3272e47e93f36c/users/f3532d40f13644a7babfd633e2a9636b/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.452908 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=460e40bb6a3c4a9ebc3272e47e93f36c, user_id=f3532d40f13644a7babfd633e2a9636b, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.455495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.465992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1187/2345] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:36 2021] PUT /identity/v3/projects/460e40bb6a3c4a9ebc3272e47e93f36c/users/f3532d40f13644a7babfd633e2a9636b/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:36.476764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.477104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.477392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.507413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] MFA Rules not processed for user `f3532d40f13644a7babfd633e2a9636b`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:36.509282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:36.581679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1159/2346] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:36 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:36.592514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.594332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:36.651899 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfa188-5156-4133-8ba7-b0e816b936fb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.655683 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.656393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.656713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.656997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.666871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.668293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:36.677732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1188/2347] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:36 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:36.923956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:36.933667 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d278e-86ea-4fa6-b13e-b4ee7042ab94 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:36.937426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da761c-a058-479e-90ae-dd7caaf219eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:36.938089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da761c-a058-479e-90ae-dd7caaf219eb service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:36.938373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da761c-a058-479e-90ae-dd7caaf219eb service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:36.938647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da761c-a058-479e-90ae-dd7caaf219eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:36.992787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da761c-a058-479e-90ae-dd7caaf219eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:36.994289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da761c-a058-479e-90ae-dd7caaf219eb service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:37.003096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1160/2348] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:36 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:39.986244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:39.987774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:40.050718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c437eb-68c1-4550-b3e1-3286da4988d5 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:40.055427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:40.056318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:40.056636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:40.056917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] PATH_INFO: `/v3/users/8f0e001c2de34ea999ded1fa3e8070ce` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:40.058131 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0e001c2de34ea999ded1fa3e8070ce)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:40.060011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:40.257971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0e001c2de34ea999ded1fa3e8070ce'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.352607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0e001c2de34ea999ded1fa3e8070ce'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.365768 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0e001c2de34ea999ded1fa3e8070ce'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.373053 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0e001c2de34ea999ded1fa3e8070ce'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.373935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0e001c2de34ea999ded1fa3e8070ce'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.380366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1189/2349] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:39 2021] DELETE /identity/v3/users/8f0e001c2de34ea999ded1fa3e8070ce => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:40.397696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:40.397696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:40.397696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:40.409719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:40.410987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:40.473502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1161/2350] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:40.484268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:40.485742 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:40.522251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:40.523724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:40.536406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd211-8c0c-4b83-8b17-1c6cc6e4d45c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:40.542032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:40.543003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:40.543355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:40.543717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] PATH_INFO: `/v3/users/b8e327a1bd7546eca8386375880f241a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:40.545341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e327a1bd7546eca8386375880f241a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:40.547558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:40.548060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34ffea-ff59-4272-8cea-fc71a1aaafe3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:40.552047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce4f18-88c2-4a27-a3af-41472512c09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:40.552748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4f18-88c2-4a27-a3af-41472512c09b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:40.553035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4f18-88c2-4a27-a3af-41472512c09b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:40.553446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4f18-88c2-4a27-a3af-41472512c09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:40.562896 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce4f18-88c2-4a27-a3af-41472512c09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:40.564514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce4f18-88c2-4a27-a3af-41472512c09b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:40.574486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1190/2351] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:40.733746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e327a1bd7546eca8386375880f241a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.734517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e327a1bd7546eca8386375880f241a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.735099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e327a1bd7546eca8386375880f241a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.826965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e327a1bd7546eca8386375880f241a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.839575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e327a1bd7546eca8386375880f241a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:40.851568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1162/2352] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:40 2021] DELETE /identity/v3/users/b8e327a1bd7546eca8386375880f241a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:40.856148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:40.856467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:40.856749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:40.873826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:40.875216 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:40.934287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1191/2353] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:40.944351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:40.945828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.001213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867923fb-ec8f-4b8e-980b-9d6d1e5fa21e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.005328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa3f7-ca7a-4543-aaf5-7bd94cf7d56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.005973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa3f7-ca7a-4543-aaf5-7bd94cf7d56c service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.006253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa3f7-ca7a-4543-aaf5-7bd94cf7d56c service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.006531 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa3f7-ca7a-4543-aaf5-7bd94cf7d56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.016764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa3f7-ca7a-4543-aaf5-7bd94cf7d56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.018286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa3f7-ca7a-4543-aaf5-7bd94cf7d56c service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.028006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1163/2354] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:41.109495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.109495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.126094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e005f21-f034-4944-a363-9539e8d2e3b3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.138622 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.139522 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.139807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.149737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] PATH_INFO: `/v3/projects/be97feed3ef7425daa59e3477b3c0ca2` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.149737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be97feed3ef7425daa59e3477b3c0ca2)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.149737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.281847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be97feed3ef7425daa59e3477b3c0ca2', 'request_id': 'req-32f28f9b-7dd3-4b4b-8127-400272c17e04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.287982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be97feed3ef7425daa59e3477b3c0ca2', 'request_id': 'req-32f28f9b-7dd3-4b4b-8127-400272c17e04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.295786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be97feed3ef7425daa59e3477b3c0ca2', 'request_id': 'req-32f28f9b-7dd3-4b4b-8127-400272c17e04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.386871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] The token cache is being invalidate because project be97feed3ef7425daa59e3477b3c0ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:41.387362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.388054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.390036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1192/2355] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:41 2021] DELETE /identity/v3/projects/be97feed3ef7425daa59e3477b3c0ca2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:41.395584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eaf77-5bf7-4515-8484-f088ae9b5eac None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.395871 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eaf77-5bf7-4515-8484-f088ae9b5eac None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.396147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eaf77-5bf7-4515-8484-f088ae9b5eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.417947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b82eaf77-5bf7-4515-8484-f088ae9b5eac None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:41.417947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b82eaf77-5bf7-4515-8484-f088ae9b5eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.470904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.472836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.478066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1164/2356] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:41.485949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.486815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.487328 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.490826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28f9b-7dd3-4b4b-8127-400272c17e04 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.498129 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.499162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.499447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.499720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] PATH_INFO: `/v3/projects/059999df53af4843aa706d226f3eb431` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.501138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=059999df53af4843aa706d226f3eb431)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.507119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.511438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:41.512712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.526225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1165/2357] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:41.532122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.542728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b52429-793b-482c-8ea2-423ea5be9b1f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.547717 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.548249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.548643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.548926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.549649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:41.549956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.551536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.564165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1166/2358] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:41.568544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.578311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d30f2-823c-4cca-a5d5-9bdab1fa5cdb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.583134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.583782 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.584067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.584346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.585058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.587031 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.639910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059999df53af4843aa706d226f3eb431', 'request_id': 'req-bcd3c49d-a129-4938-92ef-c01b805dc22d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.645288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059999df53af4843aa706d226f3eb431', 'request_id': 'req-bcd3c49d-a129-4938-92ef-c01b805dc22d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.651384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059999df53af4843aa706d226f3eb431', 'request_id': 'req-bcd3c49d-a129-4938-92ef-c01b805dc22d'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.725374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1167/2359] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:41 2021] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:41.730115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.748732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] The token cache is being invalidate because project 059999df53af4843aa706d226f3eb431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:41.749444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.750101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:41.751745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1193/2360] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:41 2021] DELETE /identity/v3/projects/059999df53af4843aa706d226f3eb431 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:41.755582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.756917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.802487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640cda4-2adc-465b-a338-511f8ff829f9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.807582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.808252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.808595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.808862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.809549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.811564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.821864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c49d-a129-4938-92ef-c01b805dc22d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.827234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.829542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.829542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.829542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] PATH_INFO: `/v3/users/f3532d40f13644a7babfd633e2a9636b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.831029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3532d40f13644a7babfd633e2a9636b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.832981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.875372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1168/2361] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:41 2021] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:41.879239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.880879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:41.892202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f6b1-1756-4a10-a63a-ed3dbba5c79c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.896808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.897444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.897744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.898000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.898709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.900793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.910273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1169/2362] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:41.913780 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.923348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86904-9a46-4d9b-8468-c20782317307 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.927999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.928643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.928929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.929204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.929887 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.931436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:41.940910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1170/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:41.946218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:41.955427 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f02be-1b61-4e9a-af1b-7a78ae11c35f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:41.959988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a5d4-e881-4ec6-bb44-89a86568cef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:41.960853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a5d4-e881-4ec6-bb44-89a86568cef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:41.961135 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a5d4-e881-4ec6-bb44-89a86568cef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:41.961412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a5d4-e881-4ec6-bb44-89a86568cef1 admin admin] PATH_INFO: `/v3/projects/4b0512034e2a455ca742b0d9706c3311/users/b1f9d80c9f524015862573414c6ea715/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:41.975508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a5d4-e881-4ec6-bb44-89a86568cef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0512034e2a455ca742b0d9706c3311, user_id=b1f9d80c9f524015862573414c6ea715, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:41.978129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a5d4-e881-4ec6-bb44-89a86568cef1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:42.045900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3532d40f13644a7babfd633e2a9636b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.069994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1171/2364] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:41 2021] PUT /identity/v3/projects/4b0512034e2a455ca742b0d9706c3311/users/b1f9d80c9f524015862573414c6ea715/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:42.073217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:42.073572 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:42.073889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:42.091439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:42.093038 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:42.113019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3532d40f13644a7babfd633e2a9636b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.125245 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3532d40f13644a7babfd633e2a9636b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.132217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3532d40f13644a7babfd633e2a9636b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.132924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3532d40f13644a7babfd633e2a9636b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.139234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1194/2365] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:41 2021] DELETE /identity/v3/users/f3532d40f13644a7babfd633e2a9636b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:42.149756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1172/2366] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:42.160095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:42.161537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:42.219151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559333a3-35b8-4e27-a817-19594c8d47bb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:42.223084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7698db-badb-4202-87d3-ff81c1baedb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:42.223777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7698db-badb-4202-87d3-ff81c1baedb3 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:42.224090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7698db-badb-4202-87d3-ff81c1baedb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:42.224799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7698db-badb-4202-87d3-ff81c1baedb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:42.285769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7698db-badb-4202-87d3-ff81c1baedb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:42.287189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7698db-badb-4202-87d3-ff81c1baedb3 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:42.297095 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1195/2367] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:42.590935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:42.592593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:42.609582 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f2918-db77-4847-95bd-2d192580beda None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:42.615705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:42.617770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:42.618065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:42.618356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] PATH_INFO: `/v3/projects/460e40bb6a3c4a9ebc3272e47e93f36c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:42.619687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460e40bb6a3c4a9ebc3272e47e93f36c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:42.621792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:42.764974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460e40bb6a3c4a9ebc3272e47e93f36c', 'request_id': 'req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.770214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460e40bb6a3c4a9ebc3272e47e93f36c', 'request_id': 'req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.776193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460e40bb6a3c4a9ebc3272e47e93f36c', 'request_id': 'req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.866280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] The token cache is being invalidate because project 460e40bb6a3c4a9ebc3272e47e93f36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:42.872174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.872174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3bd4ca41-af8c-4562-a0ba-ae49fb3c6a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:42.872174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1173/2368] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:42 2021] DELETE /identity/v3/projects/460e40bb6a3c4a9ebc3272e47e93f36c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:42.875036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:42.875328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:42.875608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:42.893007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:42.894213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:42.950840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1196/2369] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:42.959525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:42.959920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:42.960266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:42.979163 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:42.980359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:42.988911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1174/2370] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:42.993187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.003347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721efbd-d09d-4474-9314-5942b3b69720 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.007956 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.008656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.008946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.009230 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.015199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:43.015199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.015199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.023692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1197/2371] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:29:43.027726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.037634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90668ae-b764-4c28-86a1-86c73dcdc9db None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.042864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.043518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.043801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.044073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.047390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.047390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.131646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1175/2372] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:43 2021] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:43.135791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.145860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bc83c-dd18-4005-a026-6107fde20b74 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.203213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.204044 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.204332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.204641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.205364 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.207244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.328378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1198/2373] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:43 2021] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:43.329600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.339458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292830-3406-47d0-b67f-91850de84355 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.343979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.344683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.344960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.345242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.345963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.347628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.358114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1176/2374] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:43.361981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.372148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12b17-4d7e-49eb-85ec-f2b8b42253ee admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.377143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa5e6-7ca8-4a03-84de-aad545734486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.377803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa5e6-7ca8-4a03-84de-aad545734486 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.378087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa5e6-7ca8-4a03-84de-aad545734486 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.378366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa5e6-7ca8-4a03-84de-aad545734486 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.379084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa5e6-7ca8-4a03-84de-aad545734486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.380717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa5e6-7ca8-4a03-84de-aad545734486 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.390994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1199/2375] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:43.394901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.404548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e41dc-9908-42f2-872a-0a9c5bf25c0f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.410495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.411515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.411907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.412287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] PATH_INFO: `/v3/projects/847638fd792643ce8742a4eee95c386a/users/0a87615eb3c24828bb83a86520e54328/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.427438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847638fd792643ce8742a4eee95c386a, user_id=0a87615eb3c24828bb83a86520e54328, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.430183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.530090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1177/2376] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:43 2021] PUT /identity/v3/projects/847638fd792643ce8742a4eee95c386a/users/0a87615eb3c24828bb83a86520e54328/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:43.540405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651a5e6-5235-4983-981a-df5a88dd288e None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.540733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651a5e6-5235-4983-981a-df5a88dd288e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.541020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651a5e6-5235-4983-981a-df5a88dd288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.567078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b651a5e6-5235-4983-981a-df5a88dd288e None None] MFA Rules not processed for user `0a87615eb3c24828bb83a86520e54328`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:43.568504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b651a5e6-5235-4983-981a-df5a88dd288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:43.632165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1200/2377] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:43 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:43.636627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.700511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da0af-553c-4806-a3df-14f50b27e973 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.705343 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.706004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.706284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.706560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.707253 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.709179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.763148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.763448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.763732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.788878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1178/2378] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:43 2021] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:43.793406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] MFA Rules not processed for user `b1f9d80c9f524015862573414c6ea715`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:43.796081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.796196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:43.861589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1201/2379] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:43 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:43.861907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f555c-7b87-4702-bd4d-ee6f1dbf029a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.867872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.868575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.868861 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.869138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.869830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.871814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.872834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.874813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:43.931609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce9d8-ad00-42ef-810c-22d9f0d51777 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.935349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.935997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.936281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.936595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.944997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.946403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.948086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1179/2380] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:43 2021] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:43.952072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.955838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1202/2381] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:43 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:43.961693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6611-18cf-4d6b-a91e-c7a3cad9a1d9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:43.967101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:43.967765 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:43.968073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:43.968357 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:43.975124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:43.975124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:43.981234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1180/2382] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:43.985497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:43.996784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be5509-327a-49db-9cad-85e8cd7cd30b service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:44.001326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:44.002196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:44.002478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:44.002873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] PATH_INFO: `/v3/projects/ed3080ba7e084d5eaccab0e57c135129/users/076600eb441b4423b821c54b0222ef16/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:44.017870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3080ba7e084d5eaccab0e57c135129, user_id=076600eb441b4423b821c54b0222ef16, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:44.020666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:44.086537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1203/2383] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:43 2021] PUT /identity/v3/projects/ed3080ba7e084d5eaccab0e57c135129/users/076600eb441b4423b821c54b0222ef16/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:44.090593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:44.100836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ab200-b77e-4f3a-bd3d-94921f6df424 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:44.156931 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be165cf0-9e3d-4848-a3af-b24ff64cd597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:44.157598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165cf0-9e3d-4848-a3af-b24ff64cd597 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:44.157901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165cf0-9e3d-4848-a3af-b24ff64cd597 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:44.158165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165cf0-9e3d-4848-a3af-b24ff64cd597 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:44.158908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165cf0-9e3d-4848-a3af-b24ff64cd597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:44.160518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165cf0-9e3d-4848-a3af-b24ff64cd597 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:44.170289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1181/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:44 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:29:44.174466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:44.185091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb595-03b1-4f10-a8dc-4de3c8202cc5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:44.189708 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:44.190574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:44.190852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:44.191123 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] PATH_INFO: `/v3/projects/ed3080ba7e084d5eaccab0e57c135129/users/076600eb441b4423b821c54b0222ef16/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:44.193090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3080ba7e084d5eaccab0e57c135129, user_id=076600eb441b4423b821c54b0222ef16, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:44.195670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:44.206459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1204/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:44 2021] PUT /identity/v3/projects/ed3080ba7e084d5eaccab0e57c135129/users/076600eb441b4423b821c54b0222ef16/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:29:44.217370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:44.217668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:44.217980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:44.245712 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] MFA Rules not processed for user `076600eb441b4423b821c54b0222ef16`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:44.246911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:44.314431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1182/2386] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:44 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:44.331219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:44.333031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:44.388607 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd70c-ed27-4562-ab6e-de464dc7b63d admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:44.392260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:44.392937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:44.393220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:44.393495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:44.403087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:44.404523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:44.413661 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1205/2387] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:44 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:45.487077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:45.496807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05924-70a1-4bce-ae6d-9760a6a6f4d7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:45.501457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076600eb441b4423b821c54b0222ef16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3080ba7e084d5eaccab0e57c135129', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:45.502107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:45.502390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:45.502673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:45.503394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:45.503704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:45.505373 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa645a02-595e-4635-b67d-7439c0dbeb03 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:45.517792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1183/2388] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:45.521887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:45.531880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4259-2bdf-45ec-bc44-4e28737d1181 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:45.536611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076600eb441b4423b821c54b0222ef16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3080ba7e084d5eaccab0e57c135129', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:45.537259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:45.537552 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:45.537828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:45.539916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:45.540988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:45.651954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1206/2389] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:45 2021] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:29:45.655828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:45.655972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:45.656159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:45.656492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:45.674581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] MFA Rules not processed for user `b1f9d80c9f524015862573414c6ea715`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:45.675791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:45.717055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ce343-78be-4fd0-a7f0-76a3c02eca68 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:45.721821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076600eb441b4423b821c54b0222ef16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3080ba7e084d5eaccab0e57c135129', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:45.722486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:45.722780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:45.723092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:45.723791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:45.724106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:45.725847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:45.728571 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1184/2390] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:45 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:45.738506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1207/2391] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:29:45.772478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:45.783551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f439ab-c289-4d6c-b7c6-3211937b566a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:45.788672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076600eb441b4423b821c54b0222ef16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3080ba7e084d5eaccab0e57c135129', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:45.789524 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:45.789815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:45.790108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] PATH_INFO: `/v3/projects/41cfa835173e4f828bf6a720934cd746` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:45.791318 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41cfa835173e4f828bf6a720934cd746)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:45.793836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:45.901681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41cfa835173e4f828bf6a720934cd746', 'request_id': 'req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:45.906875 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41cfa835173e4f828bf6a720934cd746', 'request_id': 'req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:45.913100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41cfa835173e4f828bf6a720934cd746', 'request_id': 'req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:45.981350 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] The token cache is being invalidate because project 41cfa835173e4f828bf6a720934cd746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:45.981647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:45.982290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ada90af-8430-4d59-bbc9-d2ecdbcf4f5d tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:45.984105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1185/2392] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:45 2021] DELETE /identity/v3/projects/41cfa835173e4f828bf6a720934cd746 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:46.583431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:46.585246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:46.647321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f42df7-f948-48f7-bc6e-e701b572bd43 tempest-VolumeQuotaClassesTest-651419636 tempest-VolumeQuotaClassesTest-651419636-project-admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:46.701988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:46.702861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:46.703141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:46.703413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] PATH_INFO: `/v3/users/0a87615eb3c24828bb83a86520e54328` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:46.704611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a87615eb3c24828bb83a86520e54328)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:46.706502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:46.922990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a87615eb3c24828bb83a86520e54328'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:46.997946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a87615eb3c24828bb83a86520e54328'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.010027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a87615eb3c24828bb83a86520e54328'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.016638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a87615eb3c24828bb83a86520e54328'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.017266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a87615eb3c24828bb83a86520e54328'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.022976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1208/2393] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:46 2021] DELETE /identity/v3/users/0a87615eb3c24828bb83a86520e54328 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:47.032129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:47.032641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:47.032738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:47.050791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:47.051980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:47.110017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1186/2394] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:47.120890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:47.122290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:47.186581 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da9d0e-b9b8-4b70-a74e-cc7413492604 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:47.190232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:47.190954 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:47.191471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:47.191851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:47.201871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:47.203276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:47.212529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1209/2395] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:29:47.631126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:47.632633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:47.645566 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8e27-38f7-4058-9dde-22063d8a551f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:47.650992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:47.652773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:47.652902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:47.653134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] PATH_INFO: `/v3/projects/847638fd792643ce8742a4eee95c386a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:47.654536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847638fd792643ce8742a4eee95c386a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:47.656468 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:47.752091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847638fd792643ce8742a4eee95c386a', 'request_id': 'req-7b9b7c10-b214-470b-8fe2-98b76f764c20'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.757361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847638fd792643ce8742a4eee95c386a', 'request_id': 'req-7b9b7c10-b214-470b-8fe2-98b76f764c20'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.763506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847638fd792643ce8742a4eee95c386a', 'request_id': 'req-7b9b7c10-b214-470b-8fe2-98b76f764c20'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.858065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] The token cache is being invalidate because project 847638fd792643ce8742a4eee95c386a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:47.858361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.858983 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:47.860610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1187/2396] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:47 2021] DELETE /identity/v3/projects/847638fd792643ce8742a4eee95c386a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:47.864545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:47.873840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3d0b8-4992-465b-9da1-e5c4299d66a7 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:47.927025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:47.927883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:47.928169 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:47.928480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] PATH_INFO: `/v3/users/076600eb441b4423b821c54b0222ef16` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:47.929660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=076600eb441b4423b821c54b0222ef16)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:47.931609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:48.102554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076600eb441b4423b821c54b0222ef16'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.158064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076600eb441b4423b821c54b0222ef16'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.170155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076600eb441b4423b821c54b0222ef16'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.176648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076600eb441b4423b821c54b0222ef16'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.177277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6854592f-e770-40d1-aa49-5dc5a20d18cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076600eb441b4423b821c54b0222ef16'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.183603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1210/2397] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:29:47 2021] DELETE /identity/v3/users/076600eb441b4423b821c54b0222ef16 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:48.619442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:48.621522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:48.635370 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7c10-b214-470b-8fe2-98b76f764c20 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:48.690600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:48.691458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:48.691744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:48.692022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] PATH_INFO: `/v3/projects/ed3080ba7e084d5eaccab0e57c135129` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:48.693227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3080ba7e084d5eaccab0e57c135129)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:48.695125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:48.839515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3080ba7e084d5eaccab0e57c135129', 'request_id': 'req-d15fe370-db9e-4058-8ab6-33395b9f92fd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.845258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3080ba7e084d5eaccab0e57c135129', 'request_id': 'req-d15fe370-db9e-4058-8ab6-33395b9f92fd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.851485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3080ba7e084d5eaccab0e57c135129', 'request_id': 'req-d15fe370-db9e-4058-8ab6-33395b9f92fd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.926136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] The token cache is being invalidate because project ed3080ba7e084d5eaccab0e57c135129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:29:48.926486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.927123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-d15fe370-db9e-4058-8ab6-33395b9f92fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:29:48.929143 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1188/2398] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:29:48 2021] DELETE /identity/v3/projects/ed3080ba7e084d5eaccab0e57c135129 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:48.934814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:48.935302 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:48.935441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:48.954196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:48.959433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:49.028674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.028967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1211/2399] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:49.029515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.030850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.070882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:49.072305 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:49.082151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1189/2400] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:29:49.086482 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.097446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccd55c-7825-4565-82b3-49b62c9ea9f9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.102839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.103516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.103977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.104815 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.105947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:29:49.106412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.108155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.121286 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1212/2401] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:29:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:29:49.125671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.136562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4be15-1eef-42d5-b325-353df052fa33 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.144106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.144106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.144106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.144106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.144938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.147376 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.228306 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1190/2402] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:29:49 2021] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:49.233476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.243793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04eef-6213-4e64-a35e-0620d80dc4c0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.321524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.322206 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.322501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.322774 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.323502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.325659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.430313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1213/2403] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:29:49 2021] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:29:49.431490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.441654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37470b42-88d3-49c2-88ba-c06327d6bf83 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.446278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.446936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.447220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.447496 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.448222 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.449877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.463294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1191/2404] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:49.470856 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.481681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786237-9f04-48e3-a9e2-9a9db89acab4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.486429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847b6d9-0edb-4741-b6e6-9916c5fbc95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.487142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b6d9-0edb-4741-b6e6-9916c5fbc95b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.487427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b6d9-0edb-4741-b6e6-9916c5fbc95b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.487700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b6d9-0edb-4741-b6e6-9916c5fbc95b admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.488440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b6d9-0edb-4741-b6e6-9916c5fbc95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.490620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b6d9-0edb-4741-b6e6-9916c5fbc95b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.500986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1214/2405] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:29:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:29:49.505070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.516755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7e069-eb17-48b0-8d9b-7c3473e22b99 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.521564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.522511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.522799 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.523080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] PATH_INFO: `/v3/projects/4096cfbd3b6447519a35755dc177d61b/users/99e0eff777a54c35a48eb46ca1190090/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.540768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4096cfbd3b6447519a35755dc177d61b, user_id=99e0eff777a54c35a48eb46ca1190090, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.544684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.629881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1192/2406] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:29:49 2021] PUT /identity/v3/projects/4096cfbd3b6447519a35755dc177d61b/users/99e0eff777a54c35a48eb46ca1190090/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:29:49.641371 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f503ed7-9e8e-4799-821c-7a894ed2decc None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.641670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f503ed7-9e8e-4799-821c-7a894ed2decc None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.641952 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f503ed7-9e8e-4799-821c-7a894ed2decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.670097 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3f503ed7-9e8e-4799-821c-7a894ed2decc None None] MFA Rules not processed for user `99e0eff777a54c35a48eb46ca1190090`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:29:49.671311 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3f503ed7-9e8e-4799-821c-7a894ed2decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:49.740523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1215/2407] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:29:49 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:29:49.753188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:29:49.754951 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:29:49.837846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776fcc-a713-47e4-a63a-a77fd28faa28 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:29:49.843057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28dc03-5956-4f5a-8f35-d7922e3d4126 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:29:49.843726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28dc03-5956-4f5a-8f35-d7922e3d4126 service glance] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:29:49.844012 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28dc03-5956-4f5a-8f35-d7922e3d4126 service glance] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:29:49.844291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28dc03-5956-4f5a-8f35-d7922e3d4126 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:29:49.853392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28dc03-5956-4f5a-8f35-d7922e3d4126 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:29:49.855332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28dc03-5956-4f5a-8f35-d7922e3d4126 service glance] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:29:49.864325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1193/2408] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:29:49 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:00.049485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:00.049958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:00.050062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:00.068161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] MFA Rules not processed for user `55444e3006684638a8d1c329eaba625f`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:00.069355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:00.121844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1216/2409] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:00 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:07.015212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:07.015714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:07.015808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:07.032885 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] MFA Rules not processed for user `b1f9d80c9f524015862573414c6ea715`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:07.034017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:07.097805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1194/2410] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:10.481051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:10.484779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:10.537783 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa739aa-6258-407a-934f-6e3f1a7cabab None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:10.544823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:10.545492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:10.545778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:10.546058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:10.547849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:10.632121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:10.633632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:10.645733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1217/2411] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:14.208661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:14.219009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e5051-1ff8-46f1-8099-387859e6d6be None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:14.222829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:14.223480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:14.223768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:14.224048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:14.225881 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:14.240289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:14.241961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:14.255561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1195/2412] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:24.975722 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:24.977232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:25.046138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc21c3a-e5ea-42ae-8b9c-087779a157d4 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:25.047473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:25.048124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:25.048413 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:25.048749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:25.050508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:25.110809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:25.112295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb49b6-d51d-428b-ba52-832712b49592 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:25.122555 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1218/2413] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:24 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:28.791071 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:28.870204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945dbf8-9294-4948-b816-91e1c57b05bc service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:28.876953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:28.877831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:28.878117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:28.878391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] PATH_INFO: `/v3/users/99e0eff777a54c35a48eb46ca1190090` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:28.879600 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e0eff777a54c35a48eb46ca1190090)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:28.882090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:29.084562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e0eff777a54c35a48eb46ca1190090'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:29.085386 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e0eff777a54c35a48eb46ca1190090'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:29.086412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e0eff777a54c35a48eb46ca1190090'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:29.149530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e0eff777a54c35a48eb46ca1190090'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:29.164285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e0eff777a54c35a48eb46ca1190090'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:29.177705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1196/2414] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:30:28 2021] DELETE /identity/v3/users/99e0eff777a54c35a48eb46ca1190090 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:30:29.183173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:29.190424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:29.190424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:29.217428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:29.223639 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:29.302332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1219/2415] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:29.314311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:29.316107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:29.389173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1191-efcf-488b-9740-f48deef6c1b8 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:29.394224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d371852-a3db-46e0-98b3-1bb0942d3d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:29.395227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d371852-a3db-46e0-98b3-1bb0942d3d3b service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:29.395681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d371852-a3db-46e0-98b3-1bb0942d3d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:29.396111 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d371852-a3db-46e0-98b3-1bb0942d3d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:29.408497 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d371852-a3db-46e0-98b3-1bb0942d3d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:29.410791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d371852-a3db-46e0-98b3-1bb0942d3d3b service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:29.432914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1197/2416] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:29.914944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:29.916449 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:29.934800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eff9b-0ba2-41c7-8379-48c4a9530489 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:29.944023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:29.944023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:29.944023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:29.944023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] PATH_INFO: `/v3/projects/4096cfbd3b6447519a35755dc177d61b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:29.945843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4096cfbd3b6447519a35755dc177d61b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:29.947947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:30.101019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4096cfbd3b6447519a35755dc177d61b', 'request_id': 'req-4a7b8d45-4852-4e01-ab7b-553650d46418'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:30.109042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4096cfbd3b6447519a35755dc177d61b', 'request_id': 'req-4a7b8d45-4852-4e01-ab7b-553650d46418'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:30.117487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4096cfbd3b6447519a35755dc177d61b', 'request_id': 'req-4a7b8d45-4852-4e01-ab7b-553650d46418'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:30.250514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] The token cache is being invalidate because project 4096cfbd3b6447519a35755dc177d61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:30:30.251171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:30.251804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4a7b8d45-4852-4e01-ab7b-553650d46418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:30:30.253579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1220/2417] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:30:29 2021] DELETE /identity/v3/projects/4096cfbd3b6447519a35755dc177d61b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:30:30.262832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.263403 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.263607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.288542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:30.289911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:30.358898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1198/2418] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:30:30.366534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.366828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.367136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.386738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:30.387938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:30.396507 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1221/2419] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:30.406915 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:30.419612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4b5a6-b4ae-4515-b60d-dd1c8607f753 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:30.424702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:30.425520 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.425990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.426267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.426998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:30:30.427356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:30.429167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:30.442981 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1199/2420] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:30:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:30:30.452959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:30.471827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2f1c-0f8f-43be-bbe4-89e91af544d1 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:30.479928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:30.482814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.482814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.482814 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.483197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:30.485496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:30.623863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1222/2421] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:30:30 2021] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:30:30.625140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:30.637866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3085eb-7f7d-40c0-8fb4-a028e24f8f8b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:30.721598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:30.722344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.722629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.722906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.723603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:30.725590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:30.865104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1200/2422] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:30:30 2021] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:30:30.869476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:30.882792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7081ff-ce5d-4a86-8748-7daf329f07e2 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:30.885971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:30.886757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.887641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.888186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.889161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:30.890854 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:30.903961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1223/2423] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:30:30 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:30:30.909224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:30.921223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9476368-6311-425e-bb64-447dedfaf9ba admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:30.927273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e673a60-e4fc-45d4-82d0-afffe2ba768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:30.928242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e673a60-e4fc-45d4-82d0-afffe2ba768f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.928788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e673a60-e4fc-45d4-82d0-afffe2ba768f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.929223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e673a60-e4fc-45d4-82d0-afffe2ba768f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:30.930354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e673a60-e4fc-45d4-82d0-afffe2ba768f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:30.932338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e673a60-e4fc-45d4-82d0-afffe2ba768f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:30.959283 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1201/2424] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:30:30 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:30:30.960642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:30.973003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45311-8186-4914-925f-20626827e5dd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:30.984510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:30.992656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:30.992656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:30.992656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] PATH_INFO: `/v3/projects/84899a6b192f468fb5018fdc0cd5b51c/users/7e9305506bd64768bf088a7a6183ed90/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:31.016925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84899a6b192f468fb5018fdc0cd5b51c, user_id=7e9305506bd64768bf088a7a6183ed90, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:31.020530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:31.160636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1224/2425] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:30:30 2021] PUT /identity/v3/projects/84899a6b192f468fb5018fdc0cd5b51c/users/7e9305506bd64768bf088a7a6183ed90/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:30:31.170704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:31.175021 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:31.175356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:31.209169 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] MFA Rules not processed for user `7e9305506bd64768bf088a7a6183ed90`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:31.212494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:31.297515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1202/2426] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:31 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:31.311307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:31.317620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:31.381480 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ffd1-4d15-46c2-8b5a-3802dd02c32b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:31.385670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e61a-5adf-4d7d-904a-75cc773ac806 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:31.386421 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e61a-5adf-4d7d-904a-75cc773ac806 service glance] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:31.386806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e61a-5adf-4d7d-904a-75cc773ac806 service glance] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:31.387142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e61a-5adf-4d7d-904a-75cc773ac806 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:31.396502 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e61a-5adf-4d7d-904a-75cc773ac806 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:31.398136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e61a-5adf-4d7d-904a-75cc773ac806 service glance] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:31.407496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1225/2427] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:31 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:32.900340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:32.902405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:32.998748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138bf9-86a6-40c7-85ab-5bd347999840 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:33.009105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:33.009105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:33.009105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:33.009105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:33.009751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:33.093240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:33.095039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:33.116719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1203/2428] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:32 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:35.812938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73700fb-d8bd-4751-8fb9-1951f3fe6d60 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:35.813438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73700fb-d8bd-4751-8fb9-1951f3fe6d60 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:35.821881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73700fb-d8bd-4751-8fb9-1951f3fe6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:35.833474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f73700fb-d8bd-4751-8fb9-1951f3fe6d60 None None] MFA Rules not processed for user `d8252f18c467437699c3fb15f28ff9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:35.834758 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f73700fb-d8bd-4751-8fb9-1951f3fe6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:35.894156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1226/2429] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:30:35 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:36.207036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:36.208487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:36.269771 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872503-7371-401c-ba3e-08f3751f8c53 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:36.273519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:36.274271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:36.274655 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:36.275003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:36.276854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:36.286836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:36.288313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa411225-055f-48d3-b072-e12be8068afd service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:36.300453 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1204/2430] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:36.936717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43097d9b-b2ec-4695-b3d5-d7ea4a45c5e5 None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:36.937542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43097d9b-b2ec-4695-b3d5-d7ea4a45c5e5 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:36.937990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43097d9b-b2ec-4695-b3d5-d7ea4a45c5e5 None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:36.939931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1227/2431] 10.222.0.20 () {54 vars in 960 bytes} [Tue Sep 14 22:30:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:30:36.947426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ce508-a779-4a4e-a82d-035641b952da None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:36.947728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ce508-a779-4a4e-a82d-035641b952da None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:36.948017 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ce508-a779-4a4e-a82d-035641b952da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:36.997089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-2e5ce508-a779-4a4e-a82d-035641b952da None None] MFA Rules not processed for user `5270a4882c43439489e806c1c15a2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:36.998371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2e5ce508-a779-4a4e-a82d-035641b952da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:37.062179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1205/2432] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 14 22:30:36 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:30:37.070218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43097d9b-b2ec-4695-b3d5-d7ea4a45c5e5 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:37.084081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43097d9b-b2ec-4695-b3d5-d7ea4a45c5e5 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:37.089134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:37.089777 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:37.090071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:37.090357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:37.092117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:37.103511 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:37.105112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:37.115596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1228/2433] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:38.821631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:38.822090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:38.822205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:38.839356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:30:38.840561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:38.893389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1206/2434] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:30:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:30:39.033646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:39.035378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:39.124448 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf962-d283-4ec9-93ae-cb1b020b63a9 service placement] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:39.129650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:39.130530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:39.130879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:39.131160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:39.141042 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:39.142918 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:39.153620 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1229/2435] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:30:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:30:40.469812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:40.479602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2ab28-f10e-4ead-9559-21321dcffe43 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:40.484304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:40.485062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:40.485518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:40.485849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:40.487663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:40.497996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:40.499431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:40.507902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1207/2436] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:40 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:41.382223 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:41.404248 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5676-55e8-47cf-80c0-b829cb6d68b1 service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:41.410585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:41.411574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:41.412117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:41.412528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:41.414568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:41.430829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:41.432912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d873b0-be1b-4825-b298-b72333c281c9 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:41.449852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1230/2437] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:30:51.976537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:30:51.976537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:51.993060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754ca3-7d25-41a0-9864-490e29e15df7 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:30:52.000498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:30:52.001331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:30:52.001711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:30:52.002030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:30:52.003986 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:30:52.018508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:30:52.020352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:30:52.031615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1208/2438] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:30:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:02.262675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:02.263234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:02.263234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:02.281196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:02.282462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:02.290846 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1231/2439] 10.222.0.20 () {58 vars in 968 bytes} [Tue Sep 14 22:31:02 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:02.304018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:02.315020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a8d20-4bf6-4e32-a231-9b90fa5f0ff9 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:02.320179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:02.320858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:02.321146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:02.321426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:02.329841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:02.331401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:02.339230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1209/2440] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:31:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:31:05.467684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:05.469134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:05.532980 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddef96-c822-4918-b95c-112ed4581943 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:05.537521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:05.538383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:05.538663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:05.538942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] PATH_INFO: `/v3/users/b1f9d80c9f524015862573414c6ea715` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:05.540126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f9d80c9f524015862573414c6ea715)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:05.542112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:05.705356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f9d80c9f524015862573414c6ea715'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:05.769406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f9d80c9f524015862573414c6ea715'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:05.782165 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f9d80c9f524015862573414c6ea715'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:05.788857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f9d80c9f524015862573414c6ea715'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:05.789497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-efc31dff-7ee5-4456-a34e-d068d311b5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f9d80c9f524015862573414c6ea715'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:05.795368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1232/2441] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:31:05 2021] DELETE /identity/v3/users/b1f9d80c9f524015862573414c6ea715 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:31:06.051082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.062458 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750215f-4475-4c96-94b2-f134189a21fd service swift] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.120528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.121405 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.121689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.122500 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] PATH_INFO: `/v3/projects/4b0512034e2a455ca742b0d9706c3311` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.123637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0512034e2a455ca742b0d9706c3311)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.125610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.234463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0512034e2a455ca742b0d9706c3311', 'request_id': 'req-347f8ca1-a096-4d19-8e83-9eadb04fbac9'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:06.244494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0512034e2a455ca742b0d9706c3311', 'request_id': 'req-347f8ca1-a096-4d19-8e83-9eadb04fbac9'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:06.251530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0512034e2a455ca742b0d9706c3311', 'request_id': 'req-347f8ca1-a096-4d19-8e83-9eadb04fbac9'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:06.342433 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] The token cache is being invalidate because project 4b0512034e2a455ca742b0d9706c3311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:31:06.342616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:06.343232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-347f8ca1-a096-4d19-8e83-9eadb04fbac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:06.344783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1210/2442] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:31:06 2021] DELETE /identity/v3/projects/4b0512034e2a455ca742b0d9706c3311 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:06.350706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.351004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.351292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.368635 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:06.369828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:06.427287 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1233/2443] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:06.435423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.435801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.436145 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.454895 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:06.456183 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:06.464129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1211/2444] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:06.468221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.477977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe928-c7cb-46ce-a023-f21f605bb06c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.483410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.484083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.484375 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.484768 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.485492 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:31:06.485799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.487418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.499274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1234/2445] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:31:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:31:06.503578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.513557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d31cd-010b-4060-9fd0-3436fbdf74d0 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.518321 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.518974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.519323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.519611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.520304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.522286 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.623223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1212/2446] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:31:06 2021] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:31:06.627231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.637107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59f6e9-4c07-416a-a604-8e548a34a06e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.693582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.694251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.694660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.695001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.695769 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.697800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.799050 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1235/2447] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:31:06 2021] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:31:06.803115 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.813608 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab568f-7ad9-4388-9e1f-0991ca7a8963 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.819398 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.820080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.821058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.821058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.821494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.823122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.835646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1213/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:31:06.839811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.850785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b344-b390-4e38-a470-191680513d3a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.855530 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.861126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.861126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.861126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.861126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.861126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.869760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1236/2449] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:31:06.874252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.884022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a550ed2-fd1e-4cae-9a0c-435b30e12cbd admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.889392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5e4c-c171-4d35-85b5-68f2f3d67da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.890308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5e4c-c171-4d35-85b5-68f2f3d67da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.890606 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5e4c-c171-4d35-85b5-68f2f3d67da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.890968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5e4c-c171-4d35-85b5-68f2f3d67da4 admin admin] PATH_INFO: `/v3/projects/9c588f99d8a14e55a433e89c347e1c4d/users/7301ed3fd46b4584aa48a077008527a6/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.906683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5e4c-c171-4d35-85b5-68f2f3d67da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c588f99d8a14e55a433e89c347e1c4d, user_id=7301ed3fd46b4584aa48a077008527a6, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.909411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5e4c-c171-4d35-85b5-68f2f3d67da4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:06.910646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:06.912397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:06.925212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae643665-a766-4798-9463-0f58d325fe7e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:06.930259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:06.931013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:06.931301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:06.931585 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] PATH_INFO: `/v3/users/7e9305506bd64768bf088a7a6183ed90` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:06.932826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9305506bd64768bf088a7a6183ed90)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:06.935242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:07.023150 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1214/2450] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:31:06 2021] PUT /identity/v3/projects/9c588f99d8a14e55a433e89c347e1c4d/users/7301ed3fd46b4584aa48a077008527a6/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:07.033925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:07.034220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:07.034501 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:07.059055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] MFA Rules not processed for user `7301ed3fd46b4584aa48a077008527a6`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:07.060772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:07.121438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1215/2451] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:07 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:31:07.122715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9305506bd64768bf088a7a6183ed90'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:07.136547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:07.136547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:07.186029 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98d66-5116-4b94-9f9c-e4c78581a620 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:07.189673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00879005-2d4e-4227-ab28-89df1a28a188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:07.190329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879005-2d4e-4227-ab28-89df1a28a188 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:07.190607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879005-2d4e-4227-ab28-89df1a28a188 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:07.190880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879005-2d4e-4227-ab28-89df1a28a188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:07.198801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00879005-2d4e-4227-ab28-89df1a28a188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:07.200810 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00879005-2d4e-4227-ab28-89df1a28a188 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:07.204077 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9305506bd64768bf088a7a6183ed90'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:07.209363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1216/2452] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:07 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:31:07.216564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9305506bd64768bf088a7a6183ed90'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:07.223323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9305506bd64768bf088a7a6183ed90'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:07.224041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9305506bd64768bf088a7a6183ed90'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:07.229950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1237/2453] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:31:06 2021] DELETE /identity/v3/users/7e9305506bd64768bf088a7a6183ed90 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:07.235848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:07.236331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:07.236891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:07.257151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:07.258390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:07.317158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1217/2454] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:31:07.327566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:07.329006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:07.383672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57101e9-2704-497a-a8b0-0f8ee7947d1f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:07.387519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be676-82a7-466d-b232-ab98d10e33b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:07.388575 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be676-82a7-466d-b232-ab98d10e33b6 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:07.388859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be676-82a7-466d-b232-ab98d10e33b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:07.389135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be676-82a7-466d-b232-ab98d10e33b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:07.397903 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91be676-82a7-466d-b232-ab98d10e33b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:07.400662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91be676-82a7-466d-b232-ab98d10e33b6 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:07.409351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1238/2455] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:08.274174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:08.275604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:08.287749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ec0e-c470-4b38-8416-cfeb459deb7b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:08.292527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:08.293400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:08.293770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:08.294541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] PATH_INFO: `/v3/projects/84899a6b192f468fb5018fdc0cd5b51c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:08.295745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84899a6b192f468fb5018fdc0cd5b51c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:08.297673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:08.422627 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84899a6b192f468fb5018fdc0cd5b51c', 'request_id': 'req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:08.427758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84899a6b192f468fb5018fdc0cd5b51c', 'request_id': 'req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:08.433630 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84899a6b192f468fb5018fdc0cd5b51c', 'request_id': 'req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:08.534848 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] The token cache is being invalidate because project 84899a6b192f468fb5018fdc0cd5b51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:31:08.535079 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:08.535675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5d0fbe4c-4d40-4bf7-bd4a-49556f106203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:08.537424 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1218/2456] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:31:08 2021] DELETE /identity/v3/projects/84899a6b192f468fb5018fdc0cd5b51c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:08.543681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:08.544704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:08.544821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:08.561668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:08.572452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:08.619887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1239/2457] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:08.628702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec329-a138-4006-afb5-f9401917785c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:08.629002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec329-a138-4006-afb5-f9401917785c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:08.629289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec329-a138-4006-afb5-f9401917785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:08.647763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-38cec329-a138-4006-afb5-f9401917785c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:08.649053 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-38cec329-a138-4006-afb5-f9401917785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:08.657454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1219/2458] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:08.661542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:08.671803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ee18-07cd-43bb-b6dd-5b47a8bab8c9 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:08.676401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:08.677144 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:08.677433 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:08.677729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:08.678441 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:31:08.678754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:08.680353 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:08.691957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1240/2459] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:31:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:31:08.696055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec329-a138-4006-afb5-f9401917785c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:08.705563 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec329-a138-4006-afb5-f9401917785c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:08.710239 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:08.710880 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:08.711170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:08.711444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:08.712127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:08.714030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:08.848168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1220/2460] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:31:08 2021] POST /identity/v3/projects => generated 395 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:31:08.852436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:08.862892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd13e2-a98f-43f9-8dac-0c33a725eb1f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:08.917114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:08.917781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:08.918066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:08.918343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:08.919057 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:08.920982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:09.029944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1241/2461] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:31:08 2021] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:31:09.034131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:09.044063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435cc45-4099-4775-8b77-ce5ecb8d606d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:09.048933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:09.049709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:09.050054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:09.050412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:09.051202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:09.052798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:09.062946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1221/2462] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:31:09.066946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:09.077361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4ff1-2c48-491b-9969-a15685750922 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:09.082098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb95815-7a0a-4152-ae4a-dbb95565f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:09.082772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95815-7a0a-4152-ae4a-dbb95565f56b admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:09.083065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95815-7a0a-4152-ae4a-dbb95565f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:09.085336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95815-7a0a-4152-ae4a-dbb95565f56b admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:09.085336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb95815-7a0a-4152-ae4a-dbb95565f56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:09.086207 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb95815-7a0a-4152-ae4a-dbb95565f56b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:09.096746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1242/2463] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:31:09.101078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:09.111313 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db0d63-3321-4044-aeea-220fb7768859 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:09.115919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:09.116882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:09.117165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:09.117439 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] PATH_INFO: `/v3/projects/a2228fdf957b473eb6e6c163949ae3da/users/d73aa9b377bf4ab1ab00bb7f69cbfb7c/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:09.131863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2228fdf957b473eb6e6c163949ae3da, user_id=d73aa9b377bf4ab1ab00bb7f69cbfb7c, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:09.134540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:09.222267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1222/2464] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:31:09 2021] PUT /identity/v3/projects/a2228fdf957b473eb6e6c163949ae3da/users/d73aa9b377bf4ab1ab00bb7f69cbfb7c/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:31:09.233279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:09.233789 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:09.234077 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:09.265134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] MFA Rules not processed for user `d73aa9b377bf4ab1ab00bb7f69cbfb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:09.266360 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:09.331225 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1243/2465] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:09 2021] POST /identity/v3/auth/tokens => generated 3415 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:31:09.342056 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:09.344380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:09.402124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af2aa-49fd-4a3f-b716-d826808538a1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:09.406315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b391cc-d1a1-4d87-8784-a6e393e8b84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:09.407390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b391cc-d1a1-4d87-8784-a6e393e8b84c service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:09.407678 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b391cc-d1a1-4d87-8784-a6e393e8b84c service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:09.407958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b391cc-d1a1-4d87-8784-a6e393e8b84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:09.418464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b391cc-d1a1-4d87-8784-a6e393e8b84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:09.420118 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b391cc-d1a1-4d87-8784-a6e393e8b84c service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:09.430732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1223/2466] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:09 2021] GET /identity/v3/auth/tokens => generated 3415 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:10.489600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:10.491290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:10.559467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e3abc-2e9d-4175-955e-0329e4ab0eb6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:10.564202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:10.565121 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:10.565403 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:10.565675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] PATH_INFO: `/v3/users/7301ed3fd46b4584aa48a077008527a6` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:10.566849 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7301ed3fd46b4584aa48a077008527a6)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:10.568796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:10.732841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7301ed3fd46b4584aa48a077008527a6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:10.780648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7301ed3fd46b4584aa48a077008527a6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:10.792731 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7301ed3fd46b4584aa48a077008527a6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:10.799298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7301ed3fd46b4584aa48a077008527a6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:10.800015 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7301ed3fd46b4584aa48a077008527a6'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:10.805853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1244/2467] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:31:10 2021] DELETE /identity/v3/users/7301ed3fd46b4584aa48a077008527a6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:10.810938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:10.811431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:10.811518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:10.830146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:10.831381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:10.891934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1224/2468] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:10.901821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:10.903226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:10.958280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182662d-4ee3-4cf4-bdc6-6e644074b1ca admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:10.961937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b457b3-cb8a-4155-98e6-aa54a458484b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:10.962588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b457b3-cb8a-4155-98e6-aa54a458484b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:10.962875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b457b3-cb8a-4155-98e6-aa54a458484b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:10.963155 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b457b3-cb8a-4155-98e6-aa54a458484b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:10.972013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b457b3-cb8a-4155-98e6-aa54a458484b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:10.973464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b457b3-cb8a-4155-98e6-aa54a458484b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:10.986519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1245/2469] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:11.412400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:11.413863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:11.426475 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424c915-37ef-4e3b-acc8-46440a74b738 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:11.431213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:11.432063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:11.432354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:11.432663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] PATH_INFO: `/v3/projects/9c588f99d8a14e55a433e89c347e1c4d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:11.433843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c588f99d8a14e55a433e89c347e1c4d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:11.435834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:11.574438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c588f99d8a14e55a433e89c347e1c4d', 'request_id': 'req-91631162-f55b-4861-9449-4ba5fdc6e53c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:11.579817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c588f99d8a14e55a433e89c347e1c4d', 'request_id': 'req-91631162-f55b-4861-9449-4ba5fdc6e53c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:11.585967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c588f99d8a14e55a433e89c347e1c4d', 'request_id': 'req-91631162-f55b-4861-9449-4ba5fdc6e53c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:11.698431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] The token cache is being invalidate because project 9c588f99d8a14e55a433e89c347e1c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:31:11.698724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:11.699647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-91631162-f55b-4861-9449-4ba5fdc6e53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:11.703511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1225/2470] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:31:11 2021] DELETE /identity/v3/projects/9c588f99d8a14e55a433e89c347e1c4d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:11.708799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:11.709318 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:11.709406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:11.727870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:11.729342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:11.796748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1246/2471] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:31:11.811014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:11.811506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:11.811616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:11.830284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:11.831471 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:11.839483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1226/2472] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:11.846565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:11.856283 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82c85-de2f-4af1-88a1-a1ff33e3fd74 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:11.861215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:11.861904 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:11.862187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:11.862465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:11.863247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:31:11.863560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:11.865211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:11.878541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1247/2473] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:31:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:31:11.882695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:11.902764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f7935-192d-42ec-b127-e8562b06d20b None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:11.908291 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:11.909003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:11.909280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:11.909556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:11.910248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:11.912128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:11.989832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1227/2474] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:31:11 2021] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:31:11.994014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:12.003733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d3c3-8374-4550-aa25-17061bf592ca admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:12.057983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:12.058653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:12.058943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:12.059231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:12.059928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:12.061853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:12.143112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1248/2475] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:31:11 2021] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:31:12.147187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:12.157585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61624e-87ef-4816-bb0f-895aa075eb03 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:12.162205 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:12.162856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:12.163141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:12.163418 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:12.164134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:12.165764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:12.175794 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1228/2476] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:31:12.179465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:12.198269 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b330-538d-40da-9837-cf34cb536264 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:12.204974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddaa62-64fa-4b02-b69d-0ea54a187e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:12.207414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddaa62-64fa-4b02-b69d-0ea54a187e3d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:12.207711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddaa62-64fa-4b02-b69d-0ea54a187e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:12.207987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddaa62-64fa-4b02-b69d-0ea54a187e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:12.208981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddaa62-64fa-4b02-b69d-0ea54a187e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:12.213149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddaa62-64fa-4b02-b69d-0ea54a187e3d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:12.220847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1249/2477] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:31:12.225167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:12.235217 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49db94-3026-490f-8142-adb784bd14cf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:12.239901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:12.240806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:12.241089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:12.241365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] PATH_INFO: `/v3/projects/96471c048da84bdb879a0156053136b7/users/7c99680fe3354ed885befc183df81c8e/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:12.255864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96471c048da84bdb879a0156053136b7, user_id=7c99680fe3354ed885befc183df81c8e, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:12.258514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:12.335203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1229/2478] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:31:12 2021] PUT /identity/v3/projects/96471c048da84bdb879a0156053136b7/users/7c99680fe3354ed885befc183df81c8e/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:12.340313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839366e5-1994-4888-9b24-60ddb761c5bf None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:12.340632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839366e5-1994-4888-9b24-60ddb761c5bf None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:12.340922 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839366e5-1994-4888-9b24-60ddb761c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:12.359937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-839366e5-1994-4888-9b24-60ddb761c5bf None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:12.361162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-839366e5-1994-4888-9b24-60ddb761c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:12.418608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1250/2479] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:31:12.428144 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:12.429829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:12.484227 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5f0a-b235-48dd-b020-d9634a721b77 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:12.487901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:12.488652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:12.488966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:12.489244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:12.498811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:12.500229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:12.509515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1230/2480] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:17.778047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:17.779537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:17.780028 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:17.809727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] MFA Rules not processed for user `7c99680fe3354ed885befc183df81c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:17.812090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:17.893011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1251/2481] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:17 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:17.897510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:17.911968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a776b-647e-4b7e-9a5b-e92496eb8fe0 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:17.913839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:17.914576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:17.914930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:17.915274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:17.916034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:17.918061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.018158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1231/2482] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:31:17 2021] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:31:18.022459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:18.034204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc3e5b-ad16-403a-a568-a741ed8d9763 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:18.092337 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:18.093090 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.093383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.093664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:18.094363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:18.096556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.176726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1252/2483] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:31:18 2021] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:31:18.178081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:18.190073 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbbf3-dfe7-41d7-8e2e-161ff559fec1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:18.195308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:18.196018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.196296 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.196625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:18.197356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:18.198949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.211558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1232/2484] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:31:18.215993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:18.227075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75134-2640-4cf8-9536-60a0279faa12 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:18.251615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:18.251615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.252916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.256197 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] PATH_INFO: `/v3/projects/aaafc1f70c25485ab380adadbf108b87/users/099460a880344e1fbb62215ec94e78f4/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:18.274737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaafc1f70c25485ab380adadbf108b87, user_id=099460a880344e1fbb62215ec94e78f4, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:18.277910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.353944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1253/2485] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:31:18 2021] PUT /identity/v3/projects/aaafc1f70c25485ab380adadbf108b87/users/099460a880344e1fbb62215ec94e78f4/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:18.358377 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:18.369345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29733c-863e-41a6-98f8-6bf76befd9e1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:18.431028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:18.431902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.432187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.432504 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:18.433233 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:18.435317 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.445787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1233/2486] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:31:18 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:31:18.450041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:18.460845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ead50-a62e-4576-b0a2-e96caaab907e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:18.466038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea9b18-d58d-4432-83f3-4bdca42eac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:18.467064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea9b18-d58d-4432-83f3-4bdca42eac20 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.467456 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea9b18-d58d-4432-83f3-4bdca42eac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.467839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea9b18-d58d-4432-83f3-4bdca42eac20 admin admin] PATH_INFO: `/v3/projects/aaafc1f70c25485ab380adadbf108b87/users/099460a880344e1fbb62215ec94e78f4/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:18.470141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea9b18-d58d-4432-83f3-4bdca42eac20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaafc1f70c25485ab380adadbf108b87, user_id=099460a880344e1fbb62215ec94e78f4, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:18.472984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea9b18-d58d-4432-83f3-4bdca42eac20 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.487096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1254/2487] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:31:18 2021] PUT /identity/v3/projects/aaafc1f70c25485ab380adadbf108b87/users/099460a880344e1fbb62215ec94e78f4/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:18.604179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:18.606682 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:18.620013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577be64-29e4-49b6-9cf9-5aaa1c45d0b6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:18.681431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:18.682498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.682787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.683068 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] PATH_INFO: `/v3/users/d73aa9b377bf4ab1ab00bb7f69cbfb7c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:18.685054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73aa9b377bf4ab1ab00bb7f69cbfb7c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:18.687025 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:18.876492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73aa9b377bf4ab1ab00bb7f69cbfb7c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:18.877351 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73aa9b377bf4ab1ab00bb7f69cbfb7c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:18.878472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73aa9b377bf4ab1ab00bb7f69cbfb7c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:18.949381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73aa9b377bf4ab1ab00bb7f69cbfb7c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:18.963750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73aa9b377bf4ab1ab00bb7f69cbfb7c'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:18.979423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1234/2488] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:31:18 2021] DELETE /identity/v3/users/d73aa9b377bf4ab1ab00bb7f69cbfb7c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:31:18.984942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:18.985524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:18.986718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:19.009553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:19.011232 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:19.080217 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1255/2489] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:19.093726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:19.095192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:19.154080 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e79e-8f50-42c5-bae7-75ff94427914 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:19.158108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4db3-372e-4634-8482-e467102d66a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:19.158796 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4db3-372e-4634-8482-e467102d66a7 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:19.159081 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4db3-372e-4634-8482-e467102d66a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:19.159363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4db3-372e-4634-8482-e467102d66a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:19.169232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4db3-372e-4634-8482-e467102d66a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:19.170679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4db3-372e-4634-8482-e467102d66a7 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:19.181153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1235/2490] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:19.773605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:19.775558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:19.787890 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abd06-bb1a-4982-a11e-b680c56051c5 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:19.792894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:19.793843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:19.794307 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:19.794590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] PATH_INFO: `/v3/projects/a2228fdf957b473eb6e6c163949ae3da` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:19.796023 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2228fdf957b473eb6e6c163949ae3da)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:19.798064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:19.938368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2228fdf957b473eb6e6c163949ae3da', 'request_id': 'req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:19.943919 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2228fdf957b473eb6e6c163949ae3da', 'request_id': 'req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:19.951379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2228fdf957b473eb6e6c163949ae3da', 'request_id': 'req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:20.029294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] The token cache is being invalidate because project a2228fdf957b473eb6e6c163949ae3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:31:20.030041 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:20.030478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:31:20.037134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1256/2491] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:31:19 2021] DELETE /identity/v3/projects/a2228fdf957b473eb6e6c163949ae3da => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:31:25.358933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b503-57bb-45f4-a510-94266b5c1d11 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:25.359470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b503-57bb-45f4-a510-94266b5c1d11 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:25.359713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b503-57bb-45f4-a510-94266b5c1d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:25.414097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-61d7b503-57bb-45f4-a510-94266b5c1d11 None None] MFA Rules not processed for user `099460a880344e1fbb62215ec94e78f4`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:25.415390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-61d7b503-57bb-45f4-a510-94266b5c1d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:25.580705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1236/2492] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:25 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:25.598720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:25.615025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:25.703979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5cc66-f90b-4bd0-8cc6-ae459c8d600b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:25.708925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:25.710066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:25.710521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:25.711013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:25.713553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:25.858329 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:25.867297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:25.880234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1257/2493] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:31:25 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:31:26.179778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6a1b-3089-4caa-8eb1-c834eaea5258 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:26.180261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6a1b-3089-4caa-8eb1-c834eaea5258 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:26.180526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6a1b-3089-4caa-8eb1-c834eaea5258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:26.208890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b79b6a1b-3089-4caa-8eb1-c834eaea5258 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:26.210487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b79b6a1b-3089-4caa-8eb1-c834eaea5258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:26.282174 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1237/2494] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:31:26 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:26.296396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:26.297942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:26.371608 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599cee-1294-48e9-9616-87e87dcfceb3 service glance] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:26.376748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42c602-ce40-43f3-b550-539f4fcf35f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:26.377425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42c602-ce40-43f3-b550-539f4fcf35f4 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:26.377708 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42c602-ce40-43f3-b550-539f4fcf35f4 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:26.377986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42c602-ce40-43f3-b550-539f4fcf35f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:26.386096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42c602-ce40-43f3-b550-539f4fcf35f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:26.387659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42c602-ce40-43f3-b550-539f4fcf35f4 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:26.395685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1258/2495] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:31:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:31:29.002850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:29.003347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:29.003347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:29.040347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] MFA Rules not processed for user `0685182b9a2f48b89f8198ab861214e0`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:29.041849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:29.157176 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1238/2496] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:29 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:30.650323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edeb9-d15b-45ff-ac29-06406b6eded8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:30.650915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edeb9-d15b-45ff-ac29-06406b6eded8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:30.650915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edeb9-d15b-45ff-ac29-06406b6eded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:30.672678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6e1edeb9-d15b-45ff-ac29-06406b6eded8 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:30.673994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6e1edeb9-d15b-45ff-ac29-06406b6eded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:30.685983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1259/2497] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:31:30 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:31:30.706652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:30.722945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57854d-bd3b-403a-be08-db57eb5cc695 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:30.729649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a3204-570c-4952-993e-0d0b0936c913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:30.730312 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a3204-570c-4952-993e-0d0b0936c913 service swift] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:30.730595 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a3204-570c-4952-993e-0d0b0936c913 service swift] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:30.731410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a3204-570c-4952-993e-0d0b0936c913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:30.741261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a3204-570c-4952-993e-0d0b0936c913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:30.742943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a3204-570c-4952-993e-0d0b0936c913 service swift] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:30.755741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1239/2498] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:31:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:31:40.759946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:40.760588 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:40.760699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:40.782621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] MFA Rules not processed for user `7c99680fe3354ed885befc183df81c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:40.783883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:40.846384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1260/2499] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:31:40 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:45.495904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:45.511172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:45.511172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:45.515442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:31:45.516767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:31:45.523921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1240/2500] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:31:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:31:45.540209 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:31:45.552730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b290373-b790-4ad1-a3cd-63e42985bd78 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:31:45.557767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:31:45.558419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:31:45.558729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:31:45.560548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:31:45.569033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:31:45.570649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:31:45.579214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1261/2501] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:31:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:32:01.626560 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:01.628802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:01.689093 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:01.691457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:01.718512 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183798bd-dd5b-4e3d-8145-ace57c56fcce None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:01.725912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:01.727099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:01.727557 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:01.728010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:01.730864 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:01.748872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:01.751352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af78a-9b50-490b-b07c-9fdcafaea4f6 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:01.758076 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9cb64-6daf-4dd5-b387-8af2b29d4869 service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:01.765725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:01.771356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:01.771356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:01.771356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:01.771356 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:01.773689 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1241/2502] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:01.781051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:01.782487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457de0a-58cd-47f0-8af3-26b5219ef121 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:01.798389 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1262/2503] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:32:02.134264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b97db-1abd-4d7b-9c6e-75bb703669a8 None None] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:02.134558 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b97db-1abd-4d7b-9c6e-75bb703669a8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:02.134844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b97db-1abd-4d7b-9c6e-75bb703669a8 None None] PATH_INFO: `/` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:02.136647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1242/2504] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:32:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:32:02.143586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331487b-054a-4496-b71b-1a6dff442862 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:02.146458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331487b-054a-4496-b71b-1a6dff442862 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:02.146458 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331487b-054a-4496-b71b-1a6dff442862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:02.163408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5331487b-054a-4496-b71b-1a6dff442862 None None] MFA Rules not processed for user `f9f86a734b484993a795bb8313400e44`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:02.165586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5331487b-054a-4496-b71b-1a6dff442862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:02.179229 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1263/2505] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:32:02 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:02.196320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b97db-1abd-4d7b-9c6e-75bb703669a8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:02.198063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-371b97db-1abd-4d7b-9c6e-75bb703669a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:02.213580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b97db-1abd-4d7b-9c6e-75bb703669a8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:02.218092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f4bed-d0dc-4166-bae3-5b54493df64b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78f380f9648428989c8f0bbf87921b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:02.218971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4bed-d0dc-4166-bae3-5b54493df64b service glance] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:02.219325 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4bed-d0dc-4166-bae3-5b54493df64b service glance] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:02.219938 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4bed-d0dc-4166-bae3-5b54493df64b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:02.236570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f4bed-d0dc-4166-bae3-5b54493df64b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:02.236570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f4bed-d0dc-4166-bae3-5b54493df64b service glance] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:02.260670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1243/2506] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:02.471139 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2146e7-a467-4c79-b4c5-4a8cc695bd4f None None] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:02.471435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2146e7-a467-4c79-b4c5-4a8cc695bd4f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:02.471726 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2146e7-a467-4c79-b4c5-4a8cc695bd4f None None] PATH_INFO: `/` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:02.473720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1264/2507] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 14 22:32:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 22:32:02.479805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74f75-b6f2-4420-9790-5381fa3808ae None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:02.483007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74f75-b6f2-4420-9790-5381fa3808ae None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:02.483007 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74f75-b6f2-4420-9790-5381fa3808ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:02.502372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c4b74f75-b6f2-4420-9790-5381fa3808ae None None] MFA Rules not processed for user `7c23bd8a1b9c4a1793742ea53c56b0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:02.503736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c4b74f75-b6f2-4420-9790-5381fa3808ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:02.511549 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1244/2508] 10.222.0.20 () {58 vars in 1019 bytes} [Tue Sep 14 22:32:02 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:02.525008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2146e7-a467-4c79-b4c5-4a8cc695bd4f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:02.527018 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3e2146e7-a467-4c79-b4c5-4a8cc695bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:02.542563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2146e7-a467-4c79-b4c5-4a8cc695bd4f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:02.546778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:02.547435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:02.547717 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:02.548133 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:02.557665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:02.559501 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:02.567993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1265/2509] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:05.388781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dc1d-c198-450e-aaa3-c6caa7875dc7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:05.389285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dc1d-c198-450e-aaa3-c6caa7875dc7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:05.389394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2dc1d-c198-450e-aaa3-c6caa7875dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:05.406843 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-b6f2dc1d-c198-450e-aaa3-c6caa7875dc7 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:05.408005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b6f2dc1d-c198-450e-aaa3-c6caa7875dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:05.414897 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1245/2510] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:32:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:05.428001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:05.439682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94873f2-af54-4d01-bee9-a7c2f0b7b2db service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:05.444837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:05.445477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:05.445766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:05.446084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:05.454736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:05.456291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:05.464047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1266/2511] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:32:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 22:32:24.036742 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:24.037278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:24.037278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:24.054244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:24.055417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:24.062926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1246/2512] 10.222.0.20 () {58 vars in 968 bytes} [Tue Sep 14 22:32:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:24.075086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:24.085762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010bbcf-da71-4c01-b15c-2702473533ca service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:24.090792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:24.091430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:24.091715 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:24.091994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:24.099748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:24.101335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:24.109368 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1267/2513] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:32:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:32:30.815215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:30.824295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cfb80-480d-4726-9e49-def10734fe7d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:30.827917 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:30.828587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:30.828874 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:30.829152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:30.837787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:30.839199 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:30.848766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1247/2514] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:30 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:51.186295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:51.195862 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd941b-9144-4373-964c-04f21863b083 service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:51.199470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:51.200110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:51.200523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:51.201332 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:51.202666 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:51.267252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:51.268713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:51.278546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1268/2515] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:54.998245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:54.999700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:55.014459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0b3d-329b-42ba-aad6-f55ae729b63d service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:55.019616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:55.020497 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:55.020778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:55.021050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] PATH_INFO: `/v3/users/d8252f18c467437699c3fb15f28ff9fb` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:55.022209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8252f18c467437699c3fb15f28ff9fb)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:55.024096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:55.211852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8252f18c467437699c3fb15f28ff9fb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.212634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8252f18c467437699c3fb15f28ff9fb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.213229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8252f18c467437699c3fb15f28ff9fb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.296498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8252f18c467437699c3fb15f28ff9fb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.308809 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9bf77384-2c51-41b4-9b5a-ffbb33542c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8252f18c467437699c3fb15f28ff9fb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.321392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1248/2516] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:32:54 2021] DELETE /identity/v3/users/d8252f18c467437699c3fb15f28ff9fb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:55.664702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:55.675268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77890c8-09a9-475b-af36-84c657d68395 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:55.729902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:55.730766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:55.731054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:55.731334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] PATH_INFO: `/v3/projects/03e4651fb0b445f5bb276ac2a61a69b8` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:55.732540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e4651fb0b445f5bb276ac2a61a69b8)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:55.739019 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:55.878463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e4651fb0b445f5bb276ac2a61a69b8', 'request_id': 'req-435b5aba-a48a-4d20-97ff-ca8ace4a7383'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.883760 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e4651fb0b445f5bb276ac2a61a69b8', 'request_id': 'req-435b5aba-a48a-4d20-97ff-ca8ace4a7383'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.890168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e4651fb0b445f5bb276ac2a61a69b8', 'request_id': 'req-435b5aba-a48a-4d20-97ff-ca8ace4a7383'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.981542 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] The token cache is being invalidate because project 03e4651fb0b445f5bb276ac2a61a69b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:32:55.981840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.982467 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-435b5aba-a48a-4d20-97ff-ca8ace4a7383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:55.984005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1269/2517] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:32:55 2021] DELETE /identity/v3/projects/03e4651fb0b445f5bb276ac2a61a69b8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:55.990064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:55.997950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:55.997950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.009042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:56.010287 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:56.066911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1249/2518] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:32:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:56.074780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.075071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.075338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.093546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:56.094724 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:56.103308 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1270/2519] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:56.107375 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.118525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30fef6-e28d-4da6-978a-f23b01f206a7 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.123162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.123845 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.124130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.124410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.125160 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:32:56.125474 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.127059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.138355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1250/2520] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:32:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:32:56.143027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.152118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd5b7d-7185-42d2-bc11-4256f3d68ee3 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.156788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.158085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.158374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.158649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.159341 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.161239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.270167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1271/2521] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:32:56 2021] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:32:56.276188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.283993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc14506-ce00-4cf4-b190-d4660ddd49b3 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.336494 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.337097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.337382 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.337660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.338347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.340225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.427177 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1251/2522] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:32:56 2021] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:32:56.431292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.441797 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5cfee-eef2-47cb-8286-b0e00ac8ef3b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.446399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.447081 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.447366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.447646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.448462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.450037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.460290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1272/2523] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:32:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:32:56.464096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.473785 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18d99-103f-4b3e-bd0b-da7eddab01b6 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.478298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b37a-4a14-4f2a-9a0b-0d477ed857d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.478945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b37a-4a14-4f2a-9a0b-0d477ed857d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.479228 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b37a-4a14-4f2a-9a0b-0d477ed857d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.479502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b37a-4a14-4f2a-9a0b-0d477ed857d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.480212 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7b37a-4a14-4f2a-9a0b-0d477ed857d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.481811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7b37a-4a14-4f2a-9a0b-0d477ed857d7 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.491646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1252/2524] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:32:56 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:32:56.495426 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.505916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b61f-c849-4933-bdee-1333a8540ee5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.510611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.513125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.513125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.513125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] PATH_INFO: `/v3/projects/ef5ab0a5563240799e6bc5f73bb514e0/users/2136b144fe1248348dc8f0d30a3e2647/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.526816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5ab0a5563240799e6bc5f73bb514e0, user_id=2136b144fe1248348dc8f0d30a3e2647, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.529494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.593412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1273/2525] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:32:56 2021] PUT /identity/v3/projects/ef5ab0a5563240799e6bc5f73bb514e0/users/2136b144fe1248348dc8f0d30a3e2647/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:56.603354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.603653 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.603940 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.631290 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] MFA Rules not processed for user `2136b144fe1248348dc8f0d30a3e2647`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:56.632526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:56.694146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1253/2526] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:32:56 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:56.698536 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.756891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4791c3-b70a-47bf-a6ba-acb3e35dc67b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.761548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.762228 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.762509 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.762781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.763457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.765355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:56.857420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1274/2527] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:32:56 2021] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:32:56.862070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:56.872565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501bd1e-2300-4f97-ac81-33374e274aee None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:56.926368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:56.927027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:56.927309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:56.927585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:56.928272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:56.930234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.006120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1254/2528] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:32:56 2021] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:32:57.009997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:57.021084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e50da-490a-4bb1-9153-705d6a565b97 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:57.026173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:57.026852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.027142 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.027424 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.028168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:57.029779 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.040334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1275/2529] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:32:57.044369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:57.054198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe4037-9d54-4ce3-90eb-60b3928d7aa9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:57.058963 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:57.059972 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.060327 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.060709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] PATH_INFO: `/v3/projects/4b16f9dc9c7e402bb3584d1d0fe7e0aa/users/faba18f7d3f64c7faa44354f997f7938/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.075912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b16f9dc9c7e402bb3584d1d0fe7e0aa, user_id=faba18f7d3f64c7faa44354f997f7938, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:57.078798 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.180735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1255/2530] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:32:57 2021] PUT /identity/v3/projects/4b16f9dc9c7e402bb3584d1d0fe7e0aa/users/faba18f7d3f64c7faa44354f997f7938/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:57.184477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:57.194573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341528-46b9-4ea1-b736-b09cf8ab3201 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:57.248092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989575b-a211-42ea-8793-67c79a75761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:57.248790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989575b-a211-42ea-8793-67c79a75761a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.249072 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989575b-a211-42ea-8793-67c79a75761a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.249347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989575b-a211-42ea-8793-67c79a75761a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.250065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989575b-a211-42ea-8793-67c79a75761a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:57.252143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989575b-a211-42ea-8793-67c79a75761a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.261752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1276/2531] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:32:57.265921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:57.276482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e68810-31f9-422e-8535-0ccaa1e67efe admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:57.280982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:57.281847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.282131 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.282579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] PATH_INFO: `/v3/projects/4b16f9dc9c7e402bb3584d1d0fe7e0aa/users/faba18f7d3f64c7faa44354f997f7938/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.284522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b16f9dc9c7e402bb3584d1d0fe7e0aa, user_id=faba18f7d3f64c7faa44354f997f7938, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:57.287139 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.296995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1256/2532] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:32:57 2021] PUT /identity/v3/projects/4b16f9dc9c7e402bb3584d1d0fe7e0aa/users/faba18f7d3f64c7faa44354f997f7938/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:32:57.308198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.308529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.308819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.334807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] MFA Rules not processed for user `faba18f7d3f64c7faa44354f997f7938`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:57.336029 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:57.402529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1277/2533] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:32:57 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:32:57.412535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:57.414219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:57.467821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e89099-f1ed-4b4f-95fa-d5b96fec67e1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:57.471409 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f2e05-1212-4e2f-983c-181272e62c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:57.472036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f2e05-1212-4e2f-983c-181272e62c34 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.472321 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f2e05-1212-4e2f-983c-181272e62c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.472626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f2e05-1212-4e2f-983c-181272e62c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.481265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f2e05-1212-4e2f-983c-181272e62c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:57.482674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f2e05-1212-4e2f-983c-181272e62c34 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.492529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1257/2534] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:57 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:57.632852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:57.691612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc074c2-0798-4cdc-8620-556360f78e6c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:57.696101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:57.696987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:57.697278 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:57.697557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] PATH_INFO: `/v3/users/2136b144fe1248348dc8f0d30a3e2647` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:57.698734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2136b144fe1248348dc8f0d30a3e2647)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:57.700732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:57.909959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2136b144fe1248348dc8f0d30a3e2647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.009417 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2136b144fe1248348dc8f0d30a3e2647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.022349 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2136b144fe1248348dc8f0d30a3e2647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.028984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2136b144fe1248348dc8f0d30a3e2647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.029641 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2136b144fe1248348dc8f0d30a3e2647'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.035395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1278/2535] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:32:57 2021] DELETE /identity/v3/users/2136b144fe1248348dc8f0d30a3e2647 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:58.040537 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:58.040832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:58.041113 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:58.058393 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:58.059570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:58.122295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1258/2536] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:32:58.132340 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:58.133859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:58.189289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e573f-18bd-4d20-919b-6634526fa772 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:58.192833 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:58.193495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:58.193786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:58.194183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:58.203105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:58.204569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:58.214640 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1279/2537] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:32:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:32:58.679699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:58.681247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:58.693526 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd25fe8-d7fd-45f1-9def-48c5b20fa6df None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:58.698220 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:58.699791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:58.700075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:58.700352 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] PATH_INFO: `/v3/projects/ef5ab0a5563240799e6bc5f73bb514e0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:58.701734 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5ab0a5563240799e6bc5f73bb514e0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:58.703714 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:58.810156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5ab0a5563240799e6bc5f73bb514e0', 'request_id': 'req-a94fb084-2855-424c-87d5-b6bb90bc8b5a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.815579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5ab0a5563240799e6bc5f73bb514e0', 'request_id': 'req-a94fb084-2855-424c-87d5-b6bb90bc8b5a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.821701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5ab0a5563240799e6bc5f73bb514e0', 'request_id': 'req-a94fb084-2855-424c-87d5-b6bb90bc8b5a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.907170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] The token cache is being invalidate because project ef5ab0a5563240799e6bc5f73bb514e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:32:58.907480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.908083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:58.909698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1259/2538] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:32:58 2021] DELETE /identity/v3/projects/ef5ab0a5563240799e6bc5f73bb514e0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:58.914256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:58.923701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271a436-8255-4edf-8b96-6b804d5d1be9 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:58.976359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:58.977244 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:58.977532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:58.977813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] PATH_INFO: `/v3/users/faba18f7d3f64c7faa44354f997f7938` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:58.978990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faba18f7d3f64c7faa44354f997f7938)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:58.980924 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:59.137979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faba18f7d3f64c7faa44354f997f7938'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.205105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faba18f7d3f64c7faa44354f997f7938'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.218002 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faba18f7d3f64c7faa44354f997f7938'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.224682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faba18f7d3f64c7faa44354f997f7938'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.225324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7385993f-6d23-4c61-9ce0-a1d90a473602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faba18f7d3f64c7faa44354f997f7938'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.231071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1280/2539] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:32:58 2021] DELETE /identity/v3/users/faba18f7d3f64c7faa44354f997f7938 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:59.668123 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:32:59.671298 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:32:59.682783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fb084-2855-424c-87d5-b6bb90bc8b5a admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:32:59.735988 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:32:59.736878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:59.737158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:59.737432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] PATH_INFO: `/v3/projects/4b16f9dc9c7e402bb3584d1d0fe7e0aa` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:59.738581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b16f9dc9c7e402bb3584d1d0fe7e0aa)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:32:59.740980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:32:59.832629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b16f9dc9c7e402bb3584d1d0fe7e0aa', 'request_id': 'req-899691ef-d762-4d82-9603-b919b83adb4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.837740 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b16f9dc9c7e402bb3584d1d0fe7e0aa', 'request_id': 'req-899691ef-d762-4d82-9603-b919b83adb4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.843529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b16f9dc9c7e402bb3584d1d0fe7e0aa', 'request_id': 'req-899691ef-d762-4d82-9603-b919b83adb4b'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.923423 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] The token cache is being invalidate because project 4b16f9dc9c7e402bb3584d1d0fe7e0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:32:59.923631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.924270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-899691ef-d762-4d82-9603-b919b83adb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:32:59.925822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1260/2540] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:32:59 2021] DELETE /identity/v3/projects/4b16f9dc9c7e402bb3584d1d0fe7e0aa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:32:59.941547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:32:59.942037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:32:59.942135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:32:59.959550 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:32:59.960784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:00.017573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1281/2541] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:32:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:00.025278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552966b-6896-4428-b05a-3cedde62049f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.025565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552966b-6896-4428-b05a-3cedde62049f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.025872 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552966b-6896-4428-b05a-3cedde62049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.043980 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d552966b-6896-4428-b05a-3cedde62049f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:00.045322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d552966b-6896-4428-b05a-3cedde62049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:00.053886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1261/2542] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:00.057906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.067965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c4ca-adcf-49be-9403-e72399837005 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.072957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.073626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.073917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.074198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.074928 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:33:00.075243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.076898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.088412 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1282/2543] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:33:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:33:00.092698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552966b-6896-4428-b05a-3cedde62049f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.102028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552966b-6896-4428-b05a-3cedde62049f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.106708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.107347 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.107628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.107904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.108646 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.110787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.205660 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1262/2544] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:00 2021] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:00.210860 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.220847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767cae8-990d-4df3-ada2-bda40860c49a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.275461 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.276138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.276459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.276741 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.277437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.279333 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.365385 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1283/2545] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:00 2021] POST /identity/v3/users => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:00.369548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.379751 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73069385-6d98-42f5-97eb-c1d5c57e5751 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.385140 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.385802 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.386086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.386368 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.387214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.388830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.401117 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1263/2546] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:33:00.404734 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.415185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46eb67-92eb-4d74-896d-8bbec3485b73 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.419935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c294b59-c783-48e6-b908-ff202d964a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.420630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c294b59-c783-48e6-b908-ff202d964a7d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.420917 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c294b59-c783-48e6-b908-ff202d964a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.421198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c294b59-c783-48e6-b908-ff202d964a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.421943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c294b59-c783-48e6-b908-ff202d964a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.423516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c294b59-c783-48e6-b908-ff202d964a7d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.433523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1284/2547] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:00.437516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.447356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29951-c057-45f6-8b8d-b396d95c5751 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.452010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.452930 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.453216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.453493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] PATH_INFO: `/v3/projects/96ca0ce287254e44ae47f12da043ad1c/users/f5d5822ba5364cf5b877a6a091e9dab2/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.468136 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ca0ce287254e44ae47f12da043ad1c, user_id=f5d5822ba5364cf5b877a6a091e9dab2, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.470778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.616075 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1264/2548] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:00 2021] PUT /identity/v3/projects/96ca0ce287254e44ae47f12da043ad1c/users/f5d5822ba5364cf5b877a6a091e9dab2/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:00.631365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.631665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.631977 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.657378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] MFA Rules not processed for user `f5d5822ba5364cf5b877a6a091e9dab2`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:00.658583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:00.719793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1285/2549] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:00 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:00.724672 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.782632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf20d1-f056-4575-9296-f958b48cd824 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.787741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.788383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.788702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.788978 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.789651 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.791522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:00.868788 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1265/2550] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:00 2021] POST /identity/v3/projects => generated 357 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:00.877992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:00.888981 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cea88-062a-4ce2-b359-50d2f78d06e0 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:00.943314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:00.943975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:00.944264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:00.944574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:00.945296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:00.947188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.022733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1286/2551] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:00 2021] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:01.026464 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:01.036617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e17f-70e6-4188-beb7-38fd17a82f6e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:01.041535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:01.047440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.047440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.047440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.047440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:01.047440 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.055949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1266/2552] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:01.059979 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:01.070256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b557fb-73ed-4f7d-a9f5-0cb921d93ff8 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:01.074850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:01.075718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.076001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.076277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] PATH_INFO: `/v3/projects/02144c2228b843cd817f38bc5c602154/users/2a177635b00b466fa764c22d9c047179/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.090219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=02144c2228b843cd817f38bc5c602154, user_id=2a177635b00b466fa764c22d9c047179, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:01.092892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.164212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1287/2553] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:01 2021] PUT /identity/v3/projects/02144c2228b843cd817f38bc5c602154/users/2a177635b00b466fa764c22d9c047179/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:01.168002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:01.178156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d330ea7-f87b-4dc6-afa8-b85df9a1ec8b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:01.231686 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce27f7-af84-40f4-bdaa-820c0e12e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:01.232374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce27f7-af84-40f4-bdaa-820c0e12e1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.232690 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce27f7-af84-40f4-bdaa-820c0e12e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.233028 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce27f7-af84-40f4-bdaa-820c0e12e1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.233756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce27f7-af84-40f4-bdaa-820c0e12e1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:01.235713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce27f7-af84-40f4-bdaa-820c0e12e1f1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.246027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1267/2554] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:01 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:01.250149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:01.260764 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a6570-326b-4b75-9d3f-9f2ee2b2f1ef admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:01.265379 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:01.266251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.266534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.266813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] PATH_INFO: `/v3/projects/02144c2228b843cd817f38bc5c602154/users/2a177635b00b466fa764c22d9c047179/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.268811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02144c2228b843cd817f38bc5c602154, user_id=2a177635b00b466fa764c22d9c047179, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:01.271414 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.281346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1288/2555] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:01 2021] PUT /identity/v3/projects/02144c2228b843cd817f38bc5c602154/users/2a177635b00b466fa764c22d9c047179/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:01.292148 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.292567 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.292851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.318902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] MFA Rules not processed for user `2a177635b00b466fa764c22d9c047179`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:01.320724 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:01.386097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1268/2556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:01 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:01.396262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:01.398030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:01.457324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede467ca-37f7-4627-928c-25935fca2930 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:01.461010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:01.461656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.461946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.462247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.470988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:01.472409 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.481753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1289/2557] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:01 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:01.665767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:01.675461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b231d-8c30-475a-b5a3-8a433f42e16a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:01.679679 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:01.680341 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:01.680662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:01.680941 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:01.743232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:01.744705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:01.753482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1269/2558] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:01 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:02.244198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:02.245816 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:02.302982 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad902d39-3c33-4cde-9d63-85026b77e111 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:02.306976 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:02.307810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:02.308185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:02.308630 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:02.310546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:02.365822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:02.367233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:02.375868 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1290/2559] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:02 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:08.913598 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:08.915635 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:08.927431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a0f1-cc9b-4111-8e67-f64b95011130 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:08.931036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:08.931676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:08.931965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:08.934252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:08.934252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:08.993587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:08.994994 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:09.004218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1270/2560] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:13.387172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:13.396443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9580ff4-3f69-48bc-9f97-e6918f3182c0 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:13.401035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:13.401682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:13.401967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:13.402242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:13.404039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:13.435380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:13.437510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:13.449508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1291/2561] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:17.953410 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:17.955000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:17.980662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a1ac-286e-4442-b686-011f5e30de93 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:17.982612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:17.983495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:17.983774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:17.984059 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] PATH_INFO: `/v3/users/caaefc1301484797a60bb2d5085e029d` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:17.985786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaefc1301484797a60bb2d5085e029d)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:17.987873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:18.004927 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:18.006427 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:18.020861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a4c7-09b6-40dc-9b99-6f5cb5978d2b service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:18.025745 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:18.027564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:18.027564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:18.027564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] PATH_INFO: `/v3/users/55444e3006684638a8d1c329eaba625f` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:18.030261 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] RBAC: Authorizing `identity:delete_user(user_id=55444e3006684638a8d1c329eaba625f)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:18.032212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:18.178358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaefc1301484797a60bb2d5085e029d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.178979 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaefc1301484797a60bb2d5085e029d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.180207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaefc1301484797a60bb2d5085e029d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.202798 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55444e3006684638a8d1c329eaba625f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.244442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaefc1301484797a60bb2d5085e029d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.256642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaefc1301484797a60bb2d5085e029d'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.268854 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1271/2562] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:17 2021] DELETE /identity/v3/users/caaefc1301484797a60bb2d5085e029d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:18.313822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55444e3006684638a8d1c329eaba625f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.326049 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55444e3006684638a8d1c329eaba625f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.332955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55444e3006684638a8d1c329eaba625f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.333645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55444e3006684638a8d1c329eaba625f'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.339460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1292/2563] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:18 2021] DELETE /identity/v3/users/55444e3006684638a8d1c329eaba625f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:18.498380 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:18.499904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:18.564225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197315-d1ba-457a-bbd3-bbd47d75a11b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:18.616448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:18.617311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:18.617597 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:18.617877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] PATH_INFO: `/v3/projects/9768cf89a22e4adf9feedd402cdde0c8` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:18.619042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9768cf89a22e4adf9feedd402cdde0c8)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:18.620987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:18.715869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:18.717772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:18.731313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa01f1-8f02-4bdf-8c71-5657979903db admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:18.736753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:18.740011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:18.740011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:18.740011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] PATH_INFO: `/v3/projects/7bbe3a05bcbe4a8c9e26d656fe5e250d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:18.745883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbe3a05bcbe4a8c9e26d656fe5e250d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:18.747785 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:18.754437 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9768cf89a22e4adf9feedd402cdde0c8', 'request_id': 'req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.759812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9768cf89a22e4adf9feedd402cdde0c8', 'request_id': 'req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.765892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9768cf89a22e4adf9feedd402cdde0c8', 'request_id': 'req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.856055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] The token cache is being invalidate because project 9768cf89a22e4adf9feedd402cdde0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:18.856356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.857092 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.858682 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1272/2564] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:18 2021] DELETE /identity/v3/projects/9768cf89a22e4adf9feedd402cdde0c8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:18.862809 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:18.864121 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:18.871181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbe3a05bcbe4a8c9e26d656fe5e250d', 'request_id': 'req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.876558 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbe3a05bcbe4a8c9e26d656fe5e250d', 'request_id': 'req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.882621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbe3a05bcbe4a8c9e26d656fe5e250d', 'request_id': 'req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.925643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec122-3c84-4d8b-8b4c-a53e2e7a5c73 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:18.970141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] The token cache is being invalidate because project 7bbe3a05bcbe4a8c9e26d656fe5e250d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:18.970358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.971001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-6672a9cc-7cc9-407c-9a14-d3a72f9d8e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:18.972594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1293/2565] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:18 2021] DELETE /identity/v3/projects/7bbe3a05bcbe4a8c9e26d656fe5e250d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:18.978175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf555-e851-4f5c-b798-63597c6fa486 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:18.978545 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf555-e851-4f5c-b798-63597c6fa486 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:18.978898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf555-e851-4f5c-b798-63597c6fa486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:18.979064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:18.979948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:18.980235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:18.980552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] PATH_INFO: `/v3/users/8c282a87a2674837b686314cb7c23c2f` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:18.981823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c282a87a2674837b686314cb7c23c2f)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:18.983736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:18.996994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-1d4cf555-e851-4f5c-b798-63597c6fa486 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:18.998198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1d4cf555-e851-4f5c-b798-63597c6fa486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.006137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1294/2566] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:19.014183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.014477 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.014762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.032645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:19.037985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.041998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1295/2567] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:19.046055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.054520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e74626-a6c7-491e-a79c-e007cf37dfda None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.059167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.059792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.060082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.060365 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.061107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:33:19.061419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.062985 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.074418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1296/2568] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:33:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:33:19.078296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.088087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e334d3-f8ce-42f9-b609-97904578e812 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.092675 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.093288 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.093566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.093845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.094503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.096351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.236892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c282a87a2674837b686314cb7c23c2f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.237508 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c282a87a2674837b686314cb7c23c2f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.238133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c282a87a2674837b686314cb7c23c2f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.275066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1297/2569] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:19 2021] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:19.279126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.280800 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.325237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c282a87a2674837b686314cb7c23c2f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.343681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d975f-b805-4614-bc33-005896ff97d6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.344950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c282a87a2674837b686314cb7c23c2f'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.348565 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.349279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.349572 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.349857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.350578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.352578 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.357315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1273/2570] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:18 2021] DELETE /identity/v3/users/8c282a87a2674837b686314cb7c23c2f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:19.468516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1298/2571] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:19 2021] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:19.472723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.533013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe27ffe-a6e3-4549-b37b-8c82593fc779 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.537518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.538178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.538461 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.538732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.539443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.541189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.550907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1274/2572] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:19.555047 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.565407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2fd8-9379-4442-a612-c9153a9f99ab admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.570291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.570947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.571234 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.571568 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.572857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.581366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.584374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1299/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:19.588363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.598093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44161adf-1cd8-4bdb-bc76-f656cd0719c5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.603485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61550bb-ef4b-43b5-a18c-639d1dc26979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.604590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61550bb-ef4b-43b5-a18c-639d1dc26979 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.604878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61550bb-ef4b-43b5-a18c-639d1dc26979 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.605192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61550bb-ef4b-43b5-a18c-639d1dc26979 admin admin] PATH_INFO: `/v3/projects/5e54312e8f2f4c479015bb80f81e7ed9/users/59cb5c679fbf45359ddb251fe5380a04/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.606650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.608331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.623187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61550bb-ef4b-43b5-a18c-639d1dc26979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e54312e8f2f4c479015bb80f81e7ed9, user_id=59cb5c679fbf45359ddb251fe5380a04, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.626054 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61550bb-ef4b-43b5-a18c-639d1dc26979 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.628689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c0b7-1dd8-481b-926e-8fd84311bcb3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.634959 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.636045 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.636486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.636838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] PATH_INFO: `/v3/projects/3120a44308864f608a8b232cce6830bd` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.638107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3120a44308864f608a8b232cce6830bd)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.640080 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.720048 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1275/2574] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:19 2021] PUT /identity/v3/projects/5e54312e8f2f4c479015bb80f81e7ed9/users/59cb5c679fbf45359ddb251fe5380a04/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:19.730698 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.735481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.735481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.757299 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] MFA Rules not processed for user `59cb5c679fbf45359ddb251fe5380a04`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:19.758551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.764861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3120a44308864f608a8b232cce6830bd', 'request_id': 'req-965468f3-d2ee-490f-b2e7-ee5b00aef523'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.770235 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3120a44308864f608a8b232cce6830bd', 'request_id': 'req-965468f3-d2ee-490f-b2e7-ee5b00aef523'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.776823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3120a44308864f608a8b232cce6830bd', 'request_id': 'req-965468f3-d2ee-490f-b2e7-ee5b00aef523'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.822613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1276/2575] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:19 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:19.833710 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:19.835018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.862011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] The token cache is being invalidate because project 3120a44308864f608a8b232cce6830bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:19.862296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.862955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:19.864547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1300/2576] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:19 2021] DELETE /identity/v3/projects/3120a44308864f608a8b232cce6830bd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:19.907270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dd342-f103-4bbf-a4e0-9a7edcddab79 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:19.913422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:19.914099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:19.914419 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:19.914702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:19.917074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:19.928411 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:19.930061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1832a9-a93f-4af7-9f9f-dfd99565aa2c service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:19.940913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1277/2577] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:19 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:33:20.125108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:20.126506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:20.186355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965468f3-d2ee-490f-b2e7-ee5b00aef523 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:20.190848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:20.191707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:20.191991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:20.192266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] PATH_INFO: `/v3/users/59cb5c679fbf45359ddb251fe5380a04` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:20.193472 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=59cb5c679fbf45359ddb251fe5380a04)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:20.195381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:20.428632 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59cb5c679fbf45359ddb251fe5380a04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:20.528986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59cb5c679fbf45359ddb251fe5380a04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:20.541644 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59cb5c679fbf45359ddb251fe5380a04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:20.548465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59cb5c679fbf45359ddb251fe5380a04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:20.549189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59cb5c679fbf45359ddb251fe5380a04'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:20.555505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1301/2578] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:20 2021] DELETE /identity/v3/users/59cb5c679fbf45359ddb251fe5380a04 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:20.562027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:20.562027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:20.562027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:20.578481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:20.579661 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:20.638451 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1278/2579] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:20.650384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:20.650384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:20.703863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1838f-b513-496c-997e-5a02adcd6bcb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:20.707821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:20.708064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:20.708345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:20.708653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:20.718352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:20.719822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:20.729238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1302/2580] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:20.840817 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:20.843152 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:20.856956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda005-f1d8-4db5-96a4-b2b6362793b6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:20.862067 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:20.862919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:20.863197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:20.863466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] PATH_INFO: `/v3/users/f5d5822ba5364cf5b877a6a091e9dab2` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:20.864670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d5822ba5364cf5b877a6a091e9dab2)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:20.866626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.063842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d5822ba5364cf5b877a6a091e9dab2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.064518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d5822ba5364cf5b877a6a091e9dab2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.065124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d5822ba5364cf5b877a6a091e9dab2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.167177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.168643 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:21.170503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d5822ba5364cf5b877a6a091e9dab2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.181910 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136ad96-fd38-4d0f-a364-4184fcf97d96 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.185996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-ada952ee-d7a0-46a8-aac2-8a2461ef9a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d5822ba5364cf5b877a6a091e9dab2'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.186949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.187906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.188284 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.188685 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] PATH_INFO: `/v3/projects/5e54312e8f2f4c479015bb80f81e7ed9` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.189965 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e54312e8f2f4c479015bb80f81e7ed9)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.192184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.200074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1279/2581] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:20 2021] DELETE /identity/v3/users/f5d5822ba5364cf5b877a6a091e9dab2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:21.204607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.204906 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.205193 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.222246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:21.223478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:21.279811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1280/2582] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:21.289548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.291674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:21.330674 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e54312e8f2f4c479015bb80f81e7ed9', 'request_id': 'req-7459437b-2502-4b6c-a528-141a2376f1cc'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.336138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e54312e8f2f4c479015bb80f81e7ed9', 'request_id': 'req-7459437b-2502-4b6c-a528-141a2376f1cc'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.342549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e54312e8f2f4c479015bb80f81e7ed9', 'request_id': 'req-7459437b-2502-4b6c-a528-141a2376f1cc'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.344057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b281-206b-4fd5-accb-0f0e5f9a7dd6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.390961 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d269fd-f36d-4533-bf8d-b699fcfff11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.391632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d269fd-f36d-4533-bf8d-b699fcfff11a service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.391924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d269fd-f36d-4533-bf8d-b699fcfff11a service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.392206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d269fd-f36d-4533-bf8d-b699fcfff11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.427173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] The token cache is being invalidate because project 5e54312e8f2f4c479015bb80f81e7ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:21.427495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.428196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7459437b-2502-4b6c-a528-141a2376f1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:21.429863 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1303/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:21 2021] DELETE /identity/v3/projects/5e54312e8f2f4c479015bb80f81e7ed9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:21.435970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.436290 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.436592 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.451009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d269fd-f36d-4533-bf8d-b699fcfff11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.452515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d269fd-f36d-4533-bf8d-b699fcfff11a service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.454088 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:21.455271 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:21.461764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1281/2584] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:33:21.463282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1304/2585] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:21.470659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.470947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.471226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.489265 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:21.490449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:21.498973 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1282/2586] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:21.502888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.512537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ac83d-923b-4a90-92f8-47bd65339a02 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.517231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.517973 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.518218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.518491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.519213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:33:21.519521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.521125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.535596 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1305/2587] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:33:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:33:21.544933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.554226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545808f8-c74e-482c-b9f8-54d15a4e3d4a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.559266 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.559926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.560216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.560528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.561245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.563164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.661246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1283/2588] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:21 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:21.662384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.672925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679fb0b-5b20-4894-a6ad-3906806c666c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.732521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.734481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.734481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.734481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.734766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.736843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.821960 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1306/2589] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:21 2021] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:21.826065 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.836153 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1871d-c9ba-4be4-bd6c-8bc161e90566 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.841306 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.841958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.842244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.842521 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.843244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.844883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.855639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1284/2590] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:21.859351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.869442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9328-8feb-4658-af04-34b2adf0a99f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.874107 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.877840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.877840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.877840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.877840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.877840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.887866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1307/2591] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:21.892602 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.904406 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:21.906215 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cbd53-6b67-4899-acf6-e571be60e928 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.906351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:21.911466 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfe531-cbef-4184-8f96-8a87b14c4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.915754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfe531-cbef-4184-8f96-8a87b14c4647 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.915754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfe531-cbef-4184-8f96-8a87b14c4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.915754 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfe531-cbef-4184-8f96-8a87b14c4647 admin admin] PATH_INFO: `/v3/projects/1c1b1a7c2444474d9ccca2ccda05de16/users/c415a7277e044343900d326daa6e72aa/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.921718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7df8f-5566-4af3-8ccf-7067389a206a admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:21.927476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:21.928359 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:21.928647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfe531-cbef-4184-8f96-8a87b14c4647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1b1a7c2444474d9ccca2ccda05de16, user_id=c415a7277e044343900d326daa6e72aa, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.928741 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:21.928946 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] PATH_INFO: `/v3/projects/96ca0ce287254e44ae47f12da043ad1c` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:21.930706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ca0ce287254e44ae47f12da043ad1c)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:21.931333 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfe531-cbef-4184-8f96-8a87b14c4647 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:21.932199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.033783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1285/2592] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:21 2021] PUT /identity/v3/projects/1c1b1a7c2444474d9ccca2ccda05de16/users/c415a7277e044343900d326daa6e72aa/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:22.043901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.044194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.044525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.068549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ca0ce287254e44ae47f12da043ad1c', 'request_id': 'req-64d91cc2-80eb-44dc-81f9-f836f1f46740'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.070949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] MFA Rules not processed for user `c415a7277e044343900d326daa6e72aa`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:22.072795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.074573 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ca0ce287254e44ae47f12da043ad1c', 'request_id': 'req-64d91cc2-80eb-44dc-81f9-f836f1f46740'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.081141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ca0ce287254e44ae47f12da043ad1c', 'request_id': 'req-64d91cc2-80eb-44dc-81f9-f836f1f46740'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.133392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1286/2593] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:22 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:22.138360 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.146894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] The token cache is being invalidate because project 96ca0ce287254e44ae47f12da043ad1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:22.147256 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.147898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.149464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1308/2594] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:21 2021] DELETE /identity/v3/projects/96ca0ce287254e44ae47f12da043ad1c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:22.153842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.155259 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.201999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6380c4b-5edd-4663-9b04-9505f0ab42dd None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.206772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.207533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.207830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.208106 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.208840 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.210726 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.217114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91cc2-80eb-44dc-81f9-f836f1f46740 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.221970 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.222831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.223119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.223454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] PATH_INFO: `/v3/users/2a177635b00b466fa764c22d9c047179` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.224795 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a177635b00b466fa764c22d9c047179)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.226694 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.281490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1287/2595] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:22 2021] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:22.284995 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.286551 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.346937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c79b-2698-4a6b-99d9-50991afc4a4b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.351617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.352275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.352593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.352878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.354192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.356100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.422138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a177635b00b466fa764c22d9c047179'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.438218 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1288/2596] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:22 2021] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:22.441890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.451923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfa16a-b541-4f68-8ad6-a8d0eed4b891 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.456562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.457189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.457472 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.457750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.458487 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.460034 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.469592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1289/2597] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:22 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:33:22.473040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.481889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768263-c97b-40ae-ade5-bdbbc5475b5f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.486844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.490736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.490736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.490736 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] PATH_INFO: `/v3/projects/06535500cca84b369be629f7e5c0699d/users/771bbff052bf4abb8d143c401fb77049/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.502914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06535500cca84b369be629f7e5c0699d, user_id=771bbff052bf4abb8d143c401fb77049, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.505546 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.513342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a177635b00b466fa764c22d9c047179'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.525158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a177635b00b466fa764c22d9c047179'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.531744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a177635b00b466fa764c22d9c047179'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.532396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a177635b00b466fa764c22d9c047179'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:22.538196 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1309/2598] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:22 2021] DELETE /identity/v3/users/2a177635b00b466fa764c22d9c047179 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:22.582361 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1290/2599] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:22 2021] PUT /identity/v3/projects/06535500cca84b369be629f7e5c0699d/users/771bbff052bf4abb8d143c401fb77049/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:22.586264 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.587721 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.650444 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9157-c3c4-4ef8-b17f-2b159e61b41f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.703759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b1abb-09a5-4df9-89f2-d4ed67f4295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.704460 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b1abb-09a5-4df9-89f2-d4ed67f4295f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.704753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b1abb-09a5-4df9-89f2-d4ed67f4295f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.705034 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b1abb-09a5-4df9-89f2-d4ed67f4295f admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.705759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b1abb-09a5-4df9-89f2-d4ed67f4295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.707336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b1abb-09a5-4df9-89f2-d4ed67f4295f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.716875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1310/2600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:22 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:22.721018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.732093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b8df-ee8f-46c3-a18f-65a3a2888cdc admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.737210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.738090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.738374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.738649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] PATH_INFO: `/v3/projects/06535500cca84b369be629f7e5c0699d/users/771bbff052bf4abb8d143c401fb77049/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.740654 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=06535500cca84b369be629f7e5c0699d, user_id=771bbff052bf4abb8d143c401fb77049, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.743267 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.755134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1291/2601] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:22 2021] PUT /identity/v3/projects/06535500cca84b369be629f7e5c0699d/users/771bbff052bf4abb8d143c401fb77049/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:22.766199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.766614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.766900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.793678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] MFA Rules not processed for user `771bbff052bf4abb8d143c401fb77049`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:22.794886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.864636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1311/2602] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:22 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:22.875612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.877390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.932506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef94d-f67f-445b-936e-4644a80c98ac admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:22.936138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:22.936807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:22.937114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:22.937387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:22.947133 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:22.948544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:22.950380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:22.951998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:22.960326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1292/2603] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:22 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:23.019386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e408e-23cb-4d4e-9f72-1932d1b1c69c None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.024063 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.025496 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.025776 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.026052 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] PATH_INFO: `/v3/projects/02144c2228b843cd817f38bc5c602154` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.027220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02144c2228b843cd817f38bc5c602154)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.029143 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.119003 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02144c2228b843cd817f38bc5c602154', 'request_id': 'req-65e1e9d3-781c-4262-a984-38fa579084f3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:23.124636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02144c2228b843cd817f38bc5c602154', 'request_id': 'req-65e1e9d3-781c-4262-a984-38fa579084f3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:23.130870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02144c2228b843cd817f38bc5c602154', 'request_id': 'req-65e1e9d3-781c-4262-a984-38fa579084f3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:23.159532 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.168615 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b73f-dbc9-4843-bcdd-42dfa9779dbf service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.186839 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] The token cache is being invalidate because project 02144c2228b843cd817f38bc5c602154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:23.187136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:23.187778 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-65e1e9d3-781c-4262-a984-38fa579084f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:23.193744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1312/2604] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:22 2021] DELETE /identity/v3/projects/02144c2228b843cd817f38bc5c602154 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:23.194990 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b504e1-d54d-4738-a0fe-a564defafa27 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.195285 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b504e1-d54d-4738-a0fe-a564defafa27 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.195567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b504e1-d54d-4738-a0fe-a564defafa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.213452 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-a3b504e1-d54d-4738-a0fe-a564defafa27 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:23.214648 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a3b504e1-d54d-4738-a0fe-a564defafa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:23.216197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.217006 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.217383 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.217755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.219545 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:23.272242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1313/2605] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:23.280856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.282293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.282687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.282983 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.283265 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.297650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1293/2606] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:23 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:33:23.304949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:23.306211 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:23.317966 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1314/2607] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:23.322124 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.332830 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85d366-e4db-41ec-8f40-c06bd0bac04c service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.337926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.338583 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.338867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.339141 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.339858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:33:23.340171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.341831 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.354208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1294/2608] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:33:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:33:23.358401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.367594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845c770-2d65-4cf1-9a7f-392e36fa1c51 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.372238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.372920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.373204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.373478 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.374171 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.376038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.469227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1315/2609] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:23 2021] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:23.473428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.483339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50e9f-18fd-48bb-8277-3be4c860b3ab admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.537915 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.538603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.538892 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.539172 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.539873 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.541893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.640676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1295/2610] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:23 2021] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:23.644710 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.655407 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf0c4f-056d-4b9a-92d5-3e8e4f9e6584 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.660065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.660757 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.661040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.666362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.666362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.666362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.673673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1316/2611] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:23.677649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.687586 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113fcf-0009-4481-ace4-a3af855b410f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.693348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62644e4-a43e-47dc-a88d-5f3f7893ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.694014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62644e4-a43e-47dc-a88d-5f3f7893ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.695197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62644e4-a43e-47dc-a88d-5f3f7893ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.695197 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62644e4-a43e-47dc-a88d-5f3f7893ce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.695399 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62644e4-a43e-47dc-a88d-5f3f7893ce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.697479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62644e4-a43e-47dc-a88d-5f3f7893ce46 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.710702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1296/2612] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:33:23.719702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:23.730082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5285b9-1675-4c59-88a2-8eff167cb971 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:23.736118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:23.737266 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.737618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.737967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] PATH_INFO: `/v3/projects/fea48092c16248fb8c5f7fcd81962a80/users/9d867c417ab94977b13dfb8c390d5229/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.752870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea48092c16248fb8c5f7fcd81962a80, user_id=9d867c417ab94977b13dfb8c390d5229, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:23.755506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:23.839172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1317/2613] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:23 2021] PUT /identity/v3/projects/fea48092c16248fb8c5f7fcd81962a80/users/9d867c417ab94977b13dfb8c390d5229/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:23.850462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:23.850758 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:23.851063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:23.877322 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] MFA Rules not processed for user `9d867c417ab94977b13dfb8c390d5229`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:23.878514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:23.944390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1297/2614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:23 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:23.949118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.012331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7e9f-725d-431e-a020-1f607b51beb3 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.017071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.017824 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.018111 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.018390 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.019219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.021358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.095799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1318/2615] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:23 2021] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:24.099842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.111202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346757-f750-4e54-aa0b-7b107c8346dd None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.164249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.164958 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.165243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.165530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.166230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.168151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.245527 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1298/2616] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:24 2021] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:24.248317 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.258366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc91c95-04bc-409e-8a6c-e3b538868115 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.262947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.263597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.263880 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.264156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.264914 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.266471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.277508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1319/2617] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:24.281234 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.291126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb34f6-33f6-487a-bb07-da8b5e54fe79 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.296413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860dd26-8523-4c99-b53e-869bde6b449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.297103 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860dd26-8523-4c99-b53e-869bde6b449e admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.298666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860dd26-8523-4c99-b53e-869bde6b449e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.298666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860dd26-8523-4c99-b53e-869bde6b449e admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.298666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860dd26-8523-4c99-b53e-869bde6b449e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.299966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860dd26-8523-4c99-b53e-869bde6b449e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.310221 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1299/2618] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:24.314151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.323864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3bba-daf8-4da2-91cb-e55a389f70fc admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.328653 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.329532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.329823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.330104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] PATH_INFO: `/v3/projects/7bc6373237834f4f86414c5e1a7f40ca/users/dcbe119f62af4602aecfbdc40eff98f7/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.344199 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc6373237834f4f86414c5e1a7f40ca, user_id=dcbe119f62af4602aecfbdc40eff98f7, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.346961 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.433782 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1320/2619] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:24 2021] PUT /identity/v3/projects/7bc6373237834f4f86414c5e1a7f40ca/users/dcbe119f62af4602aecfbdc40eff98f7/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:24.443705 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.443999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.444282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.469929 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] MFA Rules not processed for user `dcbe119f62af4602aecfbdc40eff98f7`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:24.471119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:24.532432 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1300/2620] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:24 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:24.536929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.594784 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa29d2-be05-459d-b12a-9e960570b8b4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.599430 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.600085 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.600370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.600679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.601370 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.603254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.679972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1321/2621] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:24 2021] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:24.683947 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.694666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6455-40ed-4fdb-bde3-21c488fe27f2 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.750925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.751701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.751893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.752167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.752908 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.754811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.831642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1301/2622] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:24 2021] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:24.832894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.843312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db5a6-d973-4804-b3a5-99d87c4b41ae admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.848313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.849020 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.849298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.849695 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.850425 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.852001 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.864233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1322/2623] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:24.868481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.878755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245489a-1999-4db4-a462-df386d963797 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:24.883323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:24.884210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:24.884513 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:24.884791 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] PATH_INFO: `/v3/projects/380fefbd80d24ae4a1f59f5e59786599/users/a3ff4816eada4cd2993536e3f12f03a9/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:24.898932 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=380fefbd80d24ae4a1f59f5e59786599, user_id=a3ff4816eada4cd2993536e3f12f03a9, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:24.901592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:24.959146 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1302/2624] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:24 2021] PUT /identity/v3/projects/380fefbd80d24ae4a1f59f5e59786599/users/a3ff4816eada4cd2993536e3f12f03a9/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:24.963124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:24.972875 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e3f75-6583-4f27-bf60-542f3b1849fd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:25.028589 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f53370-a6e1-4bfe-88fb-64720ba7ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:25.029252 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f53370-a6e1-4bfe-88fb-64720ba7ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:25.029534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f53370-a6e1-4bfe-88fb-64720ba7ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:25.029809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f53370-a6e1-4bfe-88fb-64720ba7ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:25.030520 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f53370-a6e1-4bfe-88fb-64720ba7ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:25.032079 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f53370-a6e1-4bfe-88fb-64720ba7ebd2 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:25.041840 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1323/2625] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:25.046194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:25.056561 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90bbb-4b09-45ce-a193-a2dc6295b88d admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:25.061214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:25.062101 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:25.062371 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:25.062649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] PATH_INFO: `/v3/projects/380fefbd80d24ae4a1f59f5e59786599/users/a3ff4816eada4cd2993536e3f12f03a9/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:25.069715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=380fefbd80d24ae4a1f59f5e59786599, user_id=a3ff4816eada4cd2993536e3f12f03a9, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:25.069715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:25.077616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1303/2626] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:25 2021] PUT /identity/v3/projects/380fefbd80d24ae4a1f59f5e59786599/users/a3ff4816eada4cd2993536e3f12f03a9/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:25.087485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:25.087786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:25.088074 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:25.114454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] MFA Rules not processed for user `a3ff4816eada4cd2993536e3f12f03a9`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:25.115644 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:25.179071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1324/2627] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:25 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:25.189401 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:25.191066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:25.247503 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca08b9-166e-4916-b3da-7f550d7267bf admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:25.251223 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:25.251867 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:25.252149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:25.252534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:25.261985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:25.263400 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:25.272529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1304/2628] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:25 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:25.407399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:25.418700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c19f-5518-454a-9f92-bd4473e23b84 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:25.422664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:25.423321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:25.423705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:25.423998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:25.480876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:25.482303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:25.492006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1325/2629] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:25 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:26.805619 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:26.807036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:26.881610 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe85e3-8312-4eae-8c72-b9548db99d2b service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:26.886737 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:26.888396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:26.888396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:26.888396 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:26.889745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:26.901089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:26.903226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a24cc3-d547-4ac1-847e-19de268ad35c service placement] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:26.912989 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1305/2630] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:31.576906 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:31.644950 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4bb64-72b8-4658-a6bd-6adb187b42bf service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:31.649642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:31.658066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:31.658066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:31.658066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] PATH_INFO: `/v3/users/9d867c417ab94977b13dfb8c390d5229` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:31.658066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d867c417ab94977b13dfb8c390d5229)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:31.658066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:31.887189 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d867c417ab94977b13dfb8c390d5229'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:31.982762 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d867c417ab94977b13dfb8c390d5229'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:31.996292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d867c417ab94977b13dfb8c390d5229'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.003485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d867c417ab94977b13dfb8c390d5229'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.004242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d867c417ab94977b13dfb8c390d5229'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.010125 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1326/2631] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:31 2021] DELETE /identity/v3/users/9d867c417ab94977b13dfb8c390d5229 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:32.014577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:32.015097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:32.015097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:32.033035 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:32.034242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:32.093086 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1306/2632] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:32.103054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:32.104621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:32.162383 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3a72-2b91-4a48-bced-6700b1e1dab6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:32.166012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:32.166670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:32.166957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:32.167239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:32.176222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:32.177689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:32.187439 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1327/2633] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:32.680862 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:32.682271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:32.694192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8eb4-a757-443a-97bf-43c007d8691d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:32.698985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:32.699838 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:32.700110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:32.700394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] PATH_INFO: `/v3/projects/fea48092c16248fb8c5f7fcd81962a80` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:32.701594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea48092c16248fb8c5f7fcd81962a80)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:32.703486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:32.809968 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea48092c16248fb8c5f7fcd81962a80', 'request_id': 'req-0be1619f-7d5b-492b-b9c0-29e1fa46a170'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.815207 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea48092c16248fb8c5f7fcd81962a80', 'request_id': 'req-0be1619f-7d5b-492b-b9c0-29e1fa46a170'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.821289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea48092c16248fb8c5f7fcd81962a80', 'request_id': 'req-0be1619f-7d5b-492b-b9c0-29e1fa46a170'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.916899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] The token cache is being invalidate because project fea48092c16248fb8c5f7fcd81962a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:32.917191 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.917844 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:32.919982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1307/2634] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:32 2021] DELETE /identity/v3/projects/fea48092c16248fb8c5f7fcd81962a80 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:32.924233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:32.933614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad169a-6555-41fe-b4a4-341f070c63f6 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:32.987435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:32.988294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:32.988617 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:32.988898 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] PATH_INFO: `/v3/users/dcbe119f62af4602aecfbdc40eff98f7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:32.990070 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbe119f62af4602aecfbdc40eff98f7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:32.991971 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:33.177021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbe119f62af4602aecfbdc40eff98f7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.250377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbe119f62af4602aecfbdc40eff98f7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.263527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbe119f62af4602aecfbdc40eff98f7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.270138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbe119f62af4602aecfbdc40eff98f7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.270809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbe119f62af4602aecfbdc40eff98f7'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.276561 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1328/2635] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:32 2021] DELETE /identity/v3/users/dcbe119f62af4602aecfbdc40eff98f7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:33.697625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:33.699777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:33.713389 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1619f-7d5b-492b-b9c0-29e1fa46a170 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:33.769746 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:33.770604 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:33.770886 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:33.771162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] PATH_INFO: `/v3/projects/7bc6373237834f4f86414c5e1a7f40ca` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:33.772329 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc6373237834f4f86414c5e1a7f40ca)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:33.774297 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:33.907507 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc6373237834f4f86414c5e1a7f40ca', 'request_id': 'req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.912847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc6373237834f4f86414c5e1a7f40ca', 'request_id': 'req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.918902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc6373237834f4f86414c5e1a7f40ca', 'request_id': 'req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.998251 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] The token cache is being invalidate because project 7bc6373237834f4f86414c5e1a7f40ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:33.998480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:33.999095 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:34.000674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1308/2636] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:33 2021] DELETE /identity/v3/projects/7bc6373237834f4f86414c5e1a7f40ca => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:34.005510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:34.006185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:34.018582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425b2f9-2f1d-4761-a8b3-196e75287b0f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:34.072408 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:34.073303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:34.073590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:34.073864 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] PATH_INFO: `/v3/users/a3ff4816eada4cd2993536e3f12f03a9` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:34.075026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ff4816eada4cd2993536e3f12f03a9)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:34.077037 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:34.256766 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ff4816eada4cd2993536e3f12f03a9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:34.358614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ff4816eada4cd2993536e3f12f03a9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:34.370638 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ff4816eada4cd2993536e3f12f03a9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:34.377122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ff4816eada4cd2993536e3f12f03a9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:34.377748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3eb44cf6-1c2b-476a-ad33-ee1efdda32a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ff4816eada4cd2993536e3f12f03a9'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:34.383809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1329/2637] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:34 2021] DELETE /identity/v3/users/a3ff4816eada4cd2993536e3f12f03a9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:34.865194 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:34.865687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:34.877807 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27e20-1156-43f9-971b-7c8a5a8b9d96 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:34.932039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:34.932928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:34.933216 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:34.933490 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] PATH_INFO: `/v3/projects/380fefbd80d24ae4a1f59f5e59786599` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:34.934658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380fefbd80d24ae4a1f59f5e59786599)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:34.937043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.055254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380fefbd80d24ae4a1f59f5e59786599', 'request_id': 'req-2ec428e5-2633-45c1-b845-5351a264d4c6'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:35.060907 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380fefbd80d24ae4a1f59f5e59786599', 'request_id': 'req-2ec428e5-2633-45c1-b845-5351a264d4c6'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:35.066912 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380fefbd80d24ae4a1f59f5e59786599', 'request_id': 'req-2ec428e5-2633-45c1-b845-5351a264d4c6'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:35.158581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] The token cache is being invalidate because project 380fefbd80d24ae4a1f59f5e59786599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:35.158806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:35.159428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-2ec428e5-2633-45c1-b845-5351a264d4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:35.161011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1309/2638] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:34 2021] DELETE /identity/v3/projects/380fefbd80d24ae4a1f59f5e59786599 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:35.171493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.171493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.171493 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.189590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:35.190912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:35.250021 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1330/2639] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:35.259777 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.260074 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.260363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.279565 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:35.280832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:35.291342 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1310/2640] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:35.293709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:35.304160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11907b-71fe-4621-9bc4-9e356c26b5d2 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:35.309105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:35.312867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.312867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.312867 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.313188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:33:35.313563 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:35.315185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.326535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1331/2641] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:33:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:33:35.330913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:35.340104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479200aa-a834-4be1-9b4a-3bfe87bfc60c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:35.344832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:35.345484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.345772 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.346049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.346748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:35.348675 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.452499 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1311/2642] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:35 2021] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:35.456682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:35.466463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eefac4-e97c-4ff9-87fc-7017959c3ae9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:35.524609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:35.525292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.525582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.525865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.526749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:35.529010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.633775 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1332/2643] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:35 2021] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:35.637857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:35.648049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c026f-85ef-4152-8dc1-bf4aca05631c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:35.653005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:35.654625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.654884 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.655161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.655889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:35.657555 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.669731 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1312/2644] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:35.674378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:35.685014 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5041be-2f23-48cf-b66a-8b016bc31752 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:35.689888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b58cb-1072-4aef-a840-6e6f6585602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:35.691157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b58cb-1072-4aef-a840-6e6f6585602d admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.691157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b58cb-1072-4aef-a840-6e6f6585602d admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.691157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b58cb-1072-4aef-a840-6e6f6585602d admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.692004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b58cb-1072-4aef-a840-6e6f6585602d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:35.693625 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b58cb-1072-4aef-a840-6e6f6585602d admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.703614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1333/2645] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:33:35.707774 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:35.717945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10b5fa-4ad3-455a-98b1-f60a41b9f837 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:35.722648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:35.725662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.725662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.725662 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] PATH_INFO: `/v3/projects/df04bbbdb1a0420a9a3f27441617194d/users/abfcce3159fd46a09c202170077882dd/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.739232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df04bbbdb1a0420a9a3f27441617194d, user_id=abfcce3159fd46a09c202170077882dd, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:35.741889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:35.810364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1313/2646] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:35 2021] PUT /identity/v3/projects/df04bbbdb1a0420a9a3f27441617194d/users/abfcce3159fd46a09c202170077882dd/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:35.821435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:35.821741 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:35.822030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:35.849339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] MFA Rules not processed for user `abfcce3159fd46a09c202170077882dd`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:35.850671 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:35.912879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1334/2647] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:35 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:35.917381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.012841 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad6797-8eba-4308-8ce9-d3febaed9835 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.027444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.028529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.029002 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.030109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.030991 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.035585 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.130109 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1314/2648] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:35 2021] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:36.131614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.146025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308bc4d-e6f7-423b-9fbf-6f5fa452662a None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.223005 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.223809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.223992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.224249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.225032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.226938 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.335071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1335/2649] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:36 2021] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:36.336082 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.354434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8eae6-8473-462f-ace6-ee7bba50583c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.363465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.364388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.365078 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.365576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.366559 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.369043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.383639 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1315/2650] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:36.387929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.399707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a163265-952b-47e8-b923-02501fde981c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.404891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.405865 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.406325 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.406676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] PATH_INFO: `/v3/projects/051ea0899fd5462f82e20c9c0525b550/users/d9f9cab9fa6a40629411e484098dbda0/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.422987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051ea0899fd5462f82e20c9c0525b550, user_id=d9f9cab9fa6a40629411e484098dbda0, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.425797 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.525533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1336/2651] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:36 2021] PUT /identity/v3/projects/051ea0899fd5462f82e20c9c0525b550/users/d9f9cab9fa6a40629411e484098dbda0/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:36.531334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.541890 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcf27-f765-46f5-8161-5d07fb60220f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.596046 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa1fa7-ed80-4585-bdf8-0f48238c0fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.596767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa1fa7-ed80-4585-bdf8-0f48238c0fff admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.597051 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa1fa7-ed80-4585-bdf8-0f48238c0fff admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.597324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa1fa7-ed80-4585-bdf8-0f48238c0fff admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.598044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa1fa7-ed80-4585-bdf8-0f48238c0fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.599626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa1fa7-ed80-4585-bdf8-0f48238c0fff admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.609250 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1316/2652] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:36.613850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.625513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400267bb-0f76-4c1d-8ef3-fcadb116a638 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.630610 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.634174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.634174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.634174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] PATH_INFO: `/v3/projects/051ea0899fd5462f82e20c9c0525b550/users/d9f9cab9fa6a40629411e484098dbda0/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.634174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051ea0899fd5462f82e20c9c0525b550, user_id=d9f9cab9fa6a40629411e484098dbda0, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.636711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.647739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1337/2653] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:36 2021] PUT /identity/v3/projects/051ea0899fd5462f82e20c9c0525b550/users/d9f9cab9fa6a40629411e484098dbda0/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:36.659180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.659467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.659768 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.686369 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] MFA Rules not processed for user `d9f9cab9fa6a40629411e484098dbda0`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:36.687580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:36.768626 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1317/2654] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:36 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:36.782083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:36.784094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:36.838533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1d98-5de4-4676-b6f2-f64c1965e262 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:36.842506 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:36.843183 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:36.843465 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:36.843740 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:36.852825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:36.854386 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:36.864697 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1338/2655] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:36 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:37.164261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:37.174835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35611b92-a530-4604-a24b-ab750003f8a8 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:37.178331 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:37.178966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:37.179249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:37.179525 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:37.238515 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:37.240126 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:37.249852 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1318/2656] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:37 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:42.022998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:42.032212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2665-645b-4e70-9021-714892c7e570 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:42.035847 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:42.036513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:42.036802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:42.037083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:42.038845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:42.099377 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:42.101281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0ee86-1133-4df7-8dc0-180760e9841e service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:42.115126 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1339/2657] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:42 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:47.285428 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:47.346237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e28b-6d5a-44f9-b5e2-1e5bc737133d service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:47.350778 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:47.351674 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:47.351962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:47.352243 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] PATH_INFO: `/v3/users/abfcce3159fd46a09c202170077882dd` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:47.353457 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfcce3159fd46a09c202170077882dd)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:47.355372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:47.583459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfcce3159fd46a09c202170077882dd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:47.584104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfcce3159fd46a09c202170077882dd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:47.584722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfcce3159fd46a09c202170077882dd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:47.650670 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfcce3159fd46a09c202170077882dd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:47.664391 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfcce3159fd46a09c202170077882dd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:47.676652 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1319/2658] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:47 2021] DELETE /identity/v3/users/abfcce3159fd46a09c202170077882dd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:47.681343 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4d65-39da-42ee-84fc-61a3c409f9c0 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:47.681822 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4d65-39da-42ee-84fc-61a3c409f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:47.683491 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4d65-39da-42ee-84fc-61a3c409f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:47.698659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-fc7e4d65-39da-42ee-84fc-61a3c409f9c0 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:47.699874 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-fc7e4d65-39da-42ee-84fc-61a3c409f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:47.760078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1340/2659] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:47.770105 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:47.771808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:47.826663 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9911ce-49cc-4067-a5fa-fe02e9abb034 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:47.830450 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:47.831088 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:47.831374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:47.831688 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:47.840388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:47.842359 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:47.852715 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1320/2660] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:48.313405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:48.313835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:48.314213 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:48.335462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:48.336704 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:48.399119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1341/2661] 10.222.0.20 () {58 vars in 968 bytes} [Tue Sep 14 22:33:48 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:48.568883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:48.570276 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:48.591138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:48.591138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:48.617825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10680c1d-3f9e-46f7-bcf4-bb16e9912267 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:48.623517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:48.624380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:48.624841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:48.625148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] PATH_INFO: `/v3/projects/df04bbbdb1a0420a9a3f27441617194d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:48.626324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df04bbbdb1a0420a9a3f27441617194d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:48.628208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:48.643230 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b79e7-3cc8-4ccf-956e-1b2f9864f36d service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:48.648755 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:48.649372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:48.649658 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:48.649934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:48.658613 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:48.665793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:48.668612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1321/2662] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:33:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:33:48.781881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df04bbbdb1a0420a9a3f27441617194d', 'request_id': 'req-a1f4d0ca-bb3d-46fd-9910-9478b7062279'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:48.787178 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df04bbbdb1a0420a9a3f27441617194d', 'request_id': 'req-a1f4d0ca-bb3d-46fd-9910-9478b7062279'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:48.793348 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df04bbbdb1a0420a9a3f27441617194d', 'request_id': 'req-a1f4d0ca-bb3d-46fd-9910-9478b7062279'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:48.901431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] The token cache is being invalidate because project df04bbbdb1a0420a9a3f27441617194d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:48.901684 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:48.902327 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:48.903857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1342/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:48 2021] DELETE /identity/v3/projects/df04bbbdb1a0420a9a3f27441617194d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:48.907869 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:48.918246 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521cf6-69ef-4322-921f-e667874762ab service swift] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:48.983099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:48.983952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:48.984236 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:48.984550 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] PATH_INFO: `/v3/users/d9f9cab9fa6a40629411e484098dbda0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:48.986066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f9cab9fa6a40629411e484098dbda0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:48.987954 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:49.170203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f9cab9fa6a40629411e484098dbda0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.170783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f9cab9fa6a40629411e484098dbda0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.171394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f9cab9fa6a40629411e484098dbda0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.261641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f9cab9fa6a40629411e484098dbda0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.274668 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-69d27210-0875-4ed7-9165-2393185241c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f9cab9fa6a40629411e484098dbda0'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.286454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1322/2664] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:48 2021] DELETE /identity/v3/users/d9f9cab9fa6a40629411e484098dbda0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:49.778848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:49.780334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:49.798659 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4d0ca-bb3d-46fd-9910-9478b7062279 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:49.854025 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:49.854895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:49.855175 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:49.855445 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] PATH_INFO: `/v3/projects/051ea0899fd5462f82e20c9c0525b550` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:49.856665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051ea0899fd5462f82e20c9c0525b550)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:49.858553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:49.976521 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051ea0899fd5462f82e20c9c0525b550', 'request_id': 'req-fa8e9652-068d-4ba1-a3de-4f4e3c429828'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.983553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051ea0899fd5462f82e20c9c0525b550', 'request_id': 'req-fa8e9652-068d-4ba1-a3de-4f4e3c429828'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:49.990746 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051ea0899fd5462f82e20c9c0525b550', 'request_id': 'req-fa8e9652-068d-4ba1-a3de-4f4e3c429828'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:50.078324 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] The token cache is being invalidate because project 051ea0899fd5462f82e20c9c0525b550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:50.084691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:50.084691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-fa8e9652-068d-4ba1-a3de-4f4e3c429828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:50.084691 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1343/2665] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:49 2021] DELETE /identity/v3/projects/051ea0899fd5462f82e20c9c0525b550 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:50.088803 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.089280 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.089381 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.108702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:50.110849 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:50.167904 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1323/2666] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:50.176339 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.176738 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.177084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.195254 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:50.196615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:50.205618 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1344/2667] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:50.209939 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.220182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6d895-4b14-4afe-b1e2-ee787cf1db3a None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.224928 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.225616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.225900 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.226210 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.226987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:33:50.227242 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.228857 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:50.241273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1324/2668] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:33:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:33:50.245753 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.255039 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100fa6-a5ca-478c-8459-5fc802eb1465 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.259827 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.260535 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.260826 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.261106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.261803 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.263698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:50.352517 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1345/2669] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:50 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:50.353657 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.363756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fdfbb-e66b-4275-a229-e3b1e6b6f244 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.418773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.419448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.419739 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.420012 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.420723 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.422648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:50.530486 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1325/2670] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:50 2021] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:33:50.535016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.545249 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517312-207c-4f37-abd2-5e7173a14447 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.549894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.550549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.555700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.555700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.555700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.555700 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:50.564794 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1346/2671] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:50.568617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.579052 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e318f-c544-4ce6-977d-dbbe48ba393f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.584334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188ec7-2221-437a-87f9-1aeb1231343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.584334 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188ec7-2221-437a-87f9-1aeb1231343a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.584693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188ec7-2221-437a-87f9-1aeb1231343a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.584898 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188ec7-2221-437a-87f9-1aeb1231343a admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.585636 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188ec7-2221-437a-87f9-1aeb1231343a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.587308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188ec7-2221-437a-87f9-1aeb1231343a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:50.600061 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1326/2672] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:50.605293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.615526 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53362d98-40a4-4a0b-9782-98b1cae7ed69 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.620772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.621655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.621941 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.622219 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] PATH_INFO: `/v3/projects/665c3d37904a41e8b905b94884c43d08/users/280639f4f7be4d7d879491e8dc291a3a/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.637319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=665c3d37904a41e8b905b94884c43d08, user_id=280639f4f7be4d7d879491e8dc291a3a, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.639997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:50.730026 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1347/2673] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:50 2021] PUT /identity/v3/projects/665c3d37904a41e8b905b94884c43d08/users/280639f4f7be4d7d879491e8dc291a3a/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:50.740673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.740967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.741271 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.768692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] MFA Rules not processed for user `280639f4f7be4d7d879491e8dc291a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:50.771761 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:50.846357 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1327/2674] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:50.851485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:50.924459 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457df2-68fd-48cd-a1e2-ad424fe2cf5f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:50.929541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:50.930750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:50.931293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:50.931802 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:50.932619 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:50.934599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.022964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1348/2675] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:33:50 2021] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:51.027348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:51.039834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0a3a-bade-4ca7-adb3-d73a79615412 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:51.093795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:51.094483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.094671 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.094949 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.095631 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:51.097570 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.179406 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1328/2676] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:33:51 2021] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:33:51.180668 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:51.191476 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac73e38-c1aa-48d2-a2df-a2323486f5d9 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:51.196361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:51.197060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.197351 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.197636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.198416 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:51.200004 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.210475 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1349/2677] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:51.214708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:51.224502 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b969d2-48df-4a62-a8c1-ed5d50b8ce20 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:51.229096 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:51.229971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.230259 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.230538 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] PATH_INFO: `/v3/projects/7e9a96206cab4c8fbbae9a7b980cebc7/users/a157d3b48f354880bb8962717b252c76/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.251306 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9a96206cab4c8fbbae9a7b980cebc7, user_id=a157d3b48f354880bb8962717b252c76, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:51.254010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.314264 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1329/2678] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:51 2021] PUT /identity/v3/projects/7e9a96206cab4c8fbbae9a7b980cebc7/users/a157d3b48f354880bb8962717b252c76/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:51.319559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:51.327686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90107824-cb3f-4c48-b258-791492d98d18 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:51.388813 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d02bd-bb1c-4940-b05a-b1c7f4cf63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:51.389505 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d02bd-bb1c-4940-b05a-b1c7f4cf63f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.389974 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d02bd-bb1c-4940-b05a-b1c7f4cf63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.390844 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d02bd-bb1c-4940-b05a-b1c7f4cf63f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.391582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d02bd-bb1c-4940-b05a-b1c7f4cf63f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:51.393582 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d02bd-bb1c-4940-b05a-b1c7f4cf63f3 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.415362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1350/2679] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:33:51 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:33:51.418178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:51.435482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc21a9f-a881-46d7-9c73-ab83a03c8e5f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:51.447767 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:51.449107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.449628 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.450348 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] PATH_INFO: `/v3/projects/7e9a96206cab4c8fbbae9a7b980cebc7/users/a157d3b48f354880bb8962717b252c76/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.453666 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9a96206cab4c8fbbae9a7b980cebc7, user_id=a157d3b48f354880bb8962717b252c76, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:51.458182 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.475158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1330/2680] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:33:51 2021] PUT /identity/v3/projects/7e9a96206cab4c8fbbae9a7b980cebc7/users/a157d3b48f354880bb8962717b252c76/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:51.482599 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152f3c-5ec2-4a64-9031-577032711046 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.483017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152f3c-5ec2-4a64-9031-577032711046 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.483382 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152f3c-5ec2-4a64-9031-577032711046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.517210 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-27152f3c-5ec2-4a64-9031-577032711046 None None] MFA Rules not processed for user `a157d3b48f354880bb8962717b252c76`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:51.518564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-27152f3c-5ec2-4a64-9031-577032711046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:51.593701 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1351/2681] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:51 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:51.604993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:51.607307 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:51.674992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9f70c-eb80-4cdb-a887-fe25449fdfed admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:51.678677 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:51.679326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:51.679609 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:51.679883 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:51.736316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:51.737781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:51.746729 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1331/2682] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:33:55.944231 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:55.945122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:55.945428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:55.962539 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] MFA Rules not processed for user `0685182b9a2f48b89f8198ab861214e0`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:55.964401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:56.018958 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1352/2683] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:55 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:33:57.031229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:57.032950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:57.099339 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66eb1d-9926-40b2-9ad4-d33deeb80aa5 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:57.103948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:57.106926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:57.106926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:57.106926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] PATH_INFO: `/v3/users/7c99680fe3354ed885befc183df81c8e` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:57.106926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c99680fe3354ed885befc183df81c8e)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:57.108528 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:57.355110 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c99680fe3354ed885befc183df81c8e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:57.355812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c99680fe3354ed885befc183df81c8e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:57.356448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c99680fe3354ed885befc183df81c8e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:57.426189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c99680fe3354ed885befc183df81c8e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:57.457238 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c99680fe3354ed885befc183df81c8e'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:57.500625 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1332/2684] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:57 2021] DELETE /identity/v3/users/7c99680fe3354ed885befc183df81c8e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:57.800362 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:57.811781 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096708a-3270-43cf-9bd8-d66f55be957f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:57.866755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:57.867605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:57.867921 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:57.868198 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] PATH_INFO: `/v3/projects/96471c048da84bdb879a0156053136b7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:57.869447 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96471c048da84bdb879a0156053136b7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:57.871352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:57.999094 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96471c048da84bdb879a0156053136b7', 'request_id': 'req-71c8fb16-b616-4f9f-9537-d77d8861d024'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.004396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96471c048da84bdb879a0156053136b7', 'request_id': 'req-71c8fb16-b616-4f9f-9537-d77d8861d024'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.011532 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96471c048da84bdb879a0156053136b7', 'request_id': 'req-71c8fb16-b616-4f9f-9537-d77d8861d024'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.012355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:58.018552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:58.028588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce994ec-8c2e-4758-9632-655582c74775 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:58.092281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:58.093275 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:58.093568 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:58.093842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] PATH_INFO: `/v3/users/280639f4f7be4d7d879491e8dc291a3a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:58.095219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280639f4f7be4d7d879491e8dc291a3a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:58.097281 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:58.119247 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] The token cache is being invalidate because project 96471c048da84bdb879a0156053136b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:58.120051 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.121272 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.123994 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1353/2685] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:57 2021] DELETE /identity/v3/projects/96471c048da84bdb879a0156053136b7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:58.128345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:58.129741 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:58.143158 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb16-b616-4f9f-9537-d77d8861d024 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:58.148279 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:58.149205 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:58.149670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:58.149944 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] PATH_INFO: `/v3/users/099460a880344e1fbb62215ec94e78f4` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:58.151442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=099460a880344e1fbb62215ec94e78f4)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:58.153428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:58.326378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280639f4f7be4d7d879491e8dc291a3a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.327084 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280639f4f7be4d7d879491e8dc291a3a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.327713 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280639f4f7be4d7d879491e8dc291a3a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.330140 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099460a880344e1fbb62215ec94e78f4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.404354 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280639f4f7be4d7d879491e8dc291a3a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.416274 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-c5b6cf05-202a-4fb8-8675-59bdb790c269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280639f4f7be4d7d879491e8dc291a3a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.428616 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1333/2686] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:58 2021] DELETE /identity/v3/users/280639f4f7be4d7d879491e8dc291a3a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:58.433107 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:58.433427 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:58.433709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:58.451691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:33:58.452919 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:58.467268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099460a880344e1fbb62215ec94e78f4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.480194 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099460a880344e1fbb62215ec94e78f4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.487790 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099460a880344e1fbb62215ec94e78f4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.488636 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099460a880344e1fbb62215ec94e78f4'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.495576 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1354/2687] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:58 2021] DELETE /identity/v3/users/099460a880344e1fbb62215ec94e78f4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:58.513540 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1334/2688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:33:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:33:58.523038 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:58.524560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:58.590590 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c19f-ced9-4bca-8a48-abf982456d2e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:58.595692 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:58.597036 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:58.597665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:58.598150 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:58.667398 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:58.668873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:58.678992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1355/2689] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:33:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:33:58.790489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:58.792579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:58.821492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960b611-e484-44b4-99d1-a7de9f6c286d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:58.829909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:58.830783 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:58.831072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:58.831356 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] PATH_INFO: `/v3/projects/aaafc1f70c25485ab380adadbf108b87` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:58.832620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaafc1f70c25485ab380adadbf108b87)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:58.834629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:58.981996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaafc1f70c25485ab380adadbf108b87', 'request_id': 'req-fc5379b2-350a-443a-b223-348cc24f1566'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.988001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaafc1f70c25485ab380adadbf108b87', 'request_id': 'req-fc5379b2-350a-443a-b223-348cc24f1566'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:58.994224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaafc1f70c25485ab380adadbf108b87', 'request_id': 'req-fc5379b2-350a-443a-b223-348cc24f1566'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.100966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] The token cache is being invalidate because project aaafc1f70c25485ab380adadbf108b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:59.101704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.101943 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.103493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1335/2690] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:58 2021] DELETE /identity/v3/projects/aaafc1f70c25485ab380adadbf108b87 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:33:59.247253 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:59.248853 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:59.262739 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fabf1-a189-4c8f-b196-7831f19f6ef8 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:59.325755 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:59.326609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:59.326900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:59.327186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] PATH_INFO: `/v3/projects/665c3d37904a41e8b905b94884c43d08` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:59.328916 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665c3d37904a41e8b905b94884c43d08)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:59.330809 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:59.460201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665c3d37904a41e8b905b94884c43d08', 'request_id': 'req-7c791810-bc9c-4408-b8d3-cf2541c5fa88'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.465678 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665c3d37904a41e8b905b94884c43d08', 'request_id': 'req-7c791810-bc9c-4408-b8d3-cf2541c5fa88'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.472395 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665c3d37904a41e8b905b94884c43d08', 'request_id': 'req-7c791810-bc9c-4408-b8d3-cf2541c5fa88'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.586925 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] The token cache is being invalidate because project 665c3d37904a41e8b905b94884c43d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:33:59.587222 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.587841 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.589531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1356/2691] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:33:59 2021] DELETE /identity/v3/projects/665c3d37904a41e8b905b94884c43d08 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:33:59.593506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:33:59.594936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:33:59.607394 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5379b2-350a-443a-b223-348cc24f1566 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:33:59.666208 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:33:59.667165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:33:59.667514 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:33:59.667716 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] PATH_INFO: `/v3/users/a157d3b48f354880bb8962717b252c76` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:33:59.668993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a157d3b48f354880bb8962717b252c76)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:33:59.670937 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:33:59.835993 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a157d3b48f354880bb8962717b252c76'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.836711 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a157d3b48f354880bb8962717b252c76'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.844647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a157d3b48f354880bb8962717b252c76'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.919289 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a157d3b48f354880bb8962717b252c76'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.934102 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-307c3669-4214-4c63-9fec-1d7a8faa5ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a157d3b48f354880bb8962717b252c76'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:33:59.948004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1336/2692] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:33:59 2021] DELETE /identity/v3/users/a157d3b48f354880bb8962717b252c76 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:00.412654 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:00.418564 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:00.428435 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c791810-bc9c-4408-b8d3-cf2541c5fa88 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:00.487277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:00.488157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:00.488598 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:00.488886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] PATH_INFO: `/v3/projects/7e9a96206cab4c8fbbae9a7b980cebc7` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:00.490083 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9a96206cab4c8fbbae9a7b980cebc7)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:00.491998 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:00.615713 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9a96206cab4c8fbbae9a7b980cebc7', 'request_id': 'req-dfad68ab-b1e7-4149-bbf4-d1030d92edea'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:00.621400 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9a96206cab4c8fbbae9a7b980cebc7', 'request_id': 'req-dfad68ab-b1e7-4149-bbf4-d1030d92edea'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:00.627725 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9a96206cab4c8fbbae9a7b980cebc7', 'request_id': 'req-dfad68ab-b1e7-4149-bbf4-d1030d92edea'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:00.696887 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] The token cache is being invalidate because project 7e9a96206cab4c8fbbae9a7b980cebc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:00.697902 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:00.702464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-dfad68ab-b1e7-4149-bbf4-d1030d92edea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:00.702464 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1357/2693] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:00 2021] DELETE /identity/v3/projects/7e9a96206cab4c8fbbae9a7b980cebc7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:00.706795 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:00.707310 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:00.707416 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:00.728629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:00.730076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:00.797623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1337/2694] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:00.805195 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:00.805487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:00.805820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:00.825877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:00.827009 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:00.837838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1358/2695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:00.842055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:00.852725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b62486-d14e-40ab-b8d2-8fd0f61b85d3 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:00.866237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:00.866925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:00.867213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:00.867493 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:00.868235 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:34:00.868578 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:00.870240 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:00.882637 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1338/2696] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:34:00.887233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:00.897972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d5d4-beeb-48e4-968c-e4ab6dff2b4b None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:00.903112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:00.903873 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:00.904162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:00.904463 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:00.905164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:00.908008 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.057810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1359/2697] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:00 2021] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:01.061769 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.072119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d4d7-623e-4719-9b35-f83f43e3a76f admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.131108 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.131781 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.132062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.132338 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.133122 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.135171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.225442 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1339/2698] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:01 2021] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:01.226559 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.238470 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b1343-a00b-4921-9466-36c01a26b4a4 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.243751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.244612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.244900 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.245181 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.254174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.254174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.258837 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1360/2699] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:34:01.263020 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.273483 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207522cf-0c3a-431c-bf8c-1842848e1be0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.278192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87849ca-ce24-4a36-88b9-a8c487a75ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.278846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87849ca-ce24-4a36-88b9-a8c487a75ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.279127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87849ca-ce24-4a36-88b9-a8c487a75ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.279404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87849ca-ce24-4a36-88b9-a8c487a75ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.280116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87849ca-ce24-4a36-88b9-a8c487a75ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.282593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87849ca-ce24-4a36-88b9-a8c487a75ca4 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.292128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1340/2700] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:01.295677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.307707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e90cd-4bf1-479e-bac6-64dc3dc8383e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.313667 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.314830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.315267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.315709 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] PATH_INFO: `/v3/projects/d92a376d9717433588b0522df9cf945a/users/1db925deea164f3fbf087cbf99775774/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.333497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92a376d9717433588b0522df9cf945a, user_id=1db925deea164f3fbf087cbf99775774, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.336204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.450186 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1361/2701] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:01 2021] PUT /identity/v3/projects/d92a376d9717433588b0522df9cf945a/users/1db925deea164f3fbf087cbf99775774/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:01.460587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.460878 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.461159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.491099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] MFA Rules not processed for user `1db925deea164f3fbf087cbf99775774`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:01.492320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:01.568463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1341/2702] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:01 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:01.573101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.636397 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bbbbf-3f09-41f0-9926-bb678b30f536 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.641215 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.641877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.642167 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.642450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.643164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.645091 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.735319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1362/2703] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:01 2021] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:01.735692 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.746181 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b780d33-022c-4ff8-8ed3-526404229e7d None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.808161 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.809125 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.809694 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.810201 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.811044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.814644 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.911042 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1342/2704] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:01 2021] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:34:01.912369 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.923642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569993a-03e9-4db7-9f13-9c02439843b0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.928366 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.929054 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.929342 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.929621 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.930338 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.931911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.942347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1363/2705] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:01.950003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.960721 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50232-eb59-492c-8b93-8593e457fb00 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:01.965957 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d070b6-ae99-422f-b8a1-419b6475ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:01.966776 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d070b6-ae99-422f-b8a1-419b6475ce7f admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:01.967775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d070b6-ae99-422f-b8a1-419b6475ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:01.967775 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d070b6-ae99-422f-b8a1-419b6475ce7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:01.968902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d070b6-ae99-422f-b8a1-419b6475ce7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:01.975388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d070b6-ae99-422f-b8a1-419b6475ce7f admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:01.981188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1343/2706] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:01.985804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:01.996462 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032d2e7-3837-46aa-91d6-412223ec0d0f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.003258 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.004326 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.004623 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.015920 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] PATH_INFO: `/v3/projects/0ca3f5afdf004d9691926f7a2030b20d/users/b50517675aec4eb48cab2500c9f2f67a/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.027995 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca3f5afdf004d9691926f7a2030b20d, user_id=b50517675aec4eb48cab2500c9f2f67a, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.031437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.101986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1364/2707] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:01 2021] PUT /identity/v3/projects/0ca3f5afdf004d9691926f7a2030b20d/users/b50517675aec4eb48cab2500c9f2f67a/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:02.114000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.114294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.114580 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.144687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] MFA Rules not processed for user `b50517675aec4eb48cab2500c9f2f67a`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:02.146037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:02.211441 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1344/2708] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:02 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:02.215989 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:02.277116 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a5c6-b91f-4d39-97a7-c610841ef989 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.283850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.284549 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.284842 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.285108 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.285796 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.287690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.372544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1365/2709] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:02 2021] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:02.376797 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:02.387990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d64906-9293-4d72-9edf-df0f3db4f44f None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.455127 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.455888 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.456171 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.456470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.457170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.459364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.616700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1345/2710] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:02 2021] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:02.620761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:02.631226 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6844a-ce7e-43f1-9d2a-60fe10b89501 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.635744 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.636393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.636720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.636997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.637712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.639469 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.650246 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1366/2711] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:34:02.654920 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:02.665725 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a7a5-af5e-472d-808b-017dfa8dd305 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.670829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.671735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.672040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.672314 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] PATH_INFO: `/v3/projects/c9b2a9b8c8424768b3a69d402eeb06b5/users/9a2ef1a9d494407b8350b1d59ceccffb/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.686683 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b2a9b8c8424768b3a69d402eeb06b5, user_id=9a2ef1a9d494407b8350b1d59ceccffb, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.689842 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.775664 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1346/2712] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:02 2021] PUT /identity/v3/projects/c9b2a9b8c8424768b3a69d402eeb06b5/users/9a2ef1a9d494407b8350b1d59ceccffb/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:02.779615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:02.789732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567c739-ee77-465f-b95f-dc06f5113f76 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.844367 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63dcd-bc65-4764-9826-a449d02a8808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.845267 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63dcd-bc65-4764-9826-a449d02a8808 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.846243 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63dcd-bc65-4764-9826-a449d02a8808 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.846533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63dcd-bc65-4764-9826-a449d02a8808 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.847274 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f63dcd-bc65-4764-9826-a449d02a8808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.848886 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f63dcd-bc65-4764-9826-a449d02a8808 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.858750 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1367/2713] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:02.863935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:02.873924 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b213d5-4e1b-4ea2-a65a-a6bdfc22141e admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:02.878629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:02.879510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.879792 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.880070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] PATH_INFO: `/v3/projects/c9b2a9b8c8424768b3a69d402eeb06b5/users/9a2ef1a9d494407b8350b1d59ceccffb/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.882066 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b2a9b8c8424768b3a69d402eeb06b5, user_id=9a2ef1a9d494407b8350b1d59ceccffb, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:02.884720 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:02.894691 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1347/2714] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:02 2021] PUT /identity/v3/projects/c9b2a9b8c8424768b3a69d402eeb06b5/users/9a2ef1a9d494407b8350b1d59ceccffb/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:02.904729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:02.905027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:02.905312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:02.931646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] MFA Rules not processed for user `9a2ef1a9d494407b8350b1d59ceccffb`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:02.932895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:02.998282 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1368/2715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:02 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:34:03.008824 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:03.010492 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:03.065388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8664-7428-4e53-8d49-7cf8fc9d7030 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:03.069189 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:03.069829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:03.070112 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:03.070388 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:03.125288 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:03.126815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:03.138137 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1348/2716] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:05.201082 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:05.211204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344349-a22b-4b2a-8ead-da6e5310bec8 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:05.214597 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:05.215240 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:05.215523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:05.215810 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:05.271720 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:05.273184 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:05.282551 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1369/2717] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:05 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:06.705953 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:06.714444 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be634-a8da-473c-b92a-44677ed8ab16 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:06.718769 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb1d2d-b88a-4b7f-9c3f-9f3fc897e52a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:06.719249 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb1d2d-b88a-4b7f-9c3f-9f3fc897e52a service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:06.719535 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb1d2d-b88a-4b7f-9c3f-9f3fc897e52a service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:06.719812 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb1d2d-b88a-4b7f-9c3f-9f3fc897e52a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:06.728863 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb1d2d-b88a-4b7f-9c3f-9f3fc897e52a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:06.730278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb1d2d-b88a-4b7f-9c3f-9f3fc897e52a service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:06.740077 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1349/2718] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:06 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:13.380300 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:13.442201 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d564-e70b-4cbf-a4a1-8bfea17c4e3f service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:13.446869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:13.447729 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:13.448027 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:13.448313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] PATH_INFO: `/v3/users/1db925deea164f3fbf087cbf99775774` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:13.449702 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db925deea164f3fbf087cbf99775774)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:13.451614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:13.672699 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db925deea164f3fbf087cbf99775774'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:13.751749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db925deea164f3fbf087cbf99775774'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:13.763591 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db925deea164f3fbf087cbf99775774'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:13.773418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db925deea164f3fbf087cbf99775774'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:13.774212 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db925deea164f3fbf087cbf99775774'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:13.781179 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1370/2719] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:13 2021] DELETE /identity/v3/users/1db925deea164f3fbf087cbf99775774 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:13.785649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:13.786120 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:13.786248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:13.803925 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:13.805178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:13.862022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1350/2720] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:13.871943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:13.873418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:13.931838 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a7d76-b206-4bcf-9245-4416b5564bbd admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:13.935497 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:13.936135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:13.936442 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:13.936735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:13.945730 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:13.947137 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:13.956556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1371/2721] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:14.044402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:14.045829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:14.057967 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b838-ec6a-43ed-8ac5-070d9500720c None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:14.062620 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:14.063478 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:14.063760 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:14.064032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] PATH_INFO: `/v3/users/c415a7277e044343900d326daa6e72aa` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:14.065232 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c415a7277e044343900d326daa6e72aa)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:14.067170 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:14.248060 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c415a7277e044343900d326daa6e72aa'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.248757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c415a7277e044343900d326daa6e72aa'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.249404 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c415a7277e044343900d326daa6e72aa'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.307138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c415a7277e044343900d326daa6e72aa'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.321058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-e0ef678e-b852-421f-88b6-fb390b53a265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c415a7277e044343900d326daa6e72aa'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.336346 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1351/2722] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:14 2021] DELETE /identity/v3/users/c415a7277e044343900d326daa6e72aa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:14.338187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:14.338704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:14.339000 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:14.339282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:14.341118 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:14.356554 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde02219-b246-4a91-bf1f-a8e26405c417 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:14.361479 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:14.363579 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:14.420718 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:14.422187 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:14.422577 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:14.423188 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] PATH_INFO: `/v3/projects/d92a376d9717433588b0522df9cf945a` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:14.424374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92a376d9717433588b0522df9cf945a)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:14.426291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:14.429336 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1352/2723] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:14.439482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:14.441001 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:14.501948 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b72a-6f59-4ef8-b427-a55d65ba2956 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:14.506041 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:14.506701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:14.506987 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:14.507257 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:14.516836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:14.518260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:14.528154 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1353/2724] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:34:14.542788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92a376d9717433588b0522df9cf945a', 'request_id': 'req-7f229ef7-a356-4e59-8ada-f629dbafa345'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.548624 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92a376d9717433588b0522df9cf945a', 'request_id': 'req-7f229ef7-a356-4e59-8ada-f629dbafa345'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.554712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92a376d9717433588b0522df9cf945a', 'request_id': 'req-7f229ef7-a356-4e59-8ada-f629dbafa345'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.648830 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] The token cache is being invalidate because project d92a376d9717433588b0522df9cf945a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:14.649030 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.649727 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.651346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1372/2725] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:14 2021] DELETE /identity/v3/projects/d92a376d9717433588b0522df9cf945a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:14.655365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:14.657252 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:14.669617 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171f600-fc40-481a-b0dd-9089569df0b7 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:14.727632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:14.728539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:14.728828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:14.729104 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] PATH_INFO: `/v3/users/b50517675aec4eb48cab2500c9f2f67a` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:14.730306 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50517675aec4eb48cab2500c9f2f67a)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:14.732272 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:14.918701 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50517675aec4eb48cab2500c9f2f67a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.919762 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50517675aec4eb48cab2500c9f2f67a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.920476 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50517675aec4eb48cab2500c9f2f67a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.975425 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50517675aec4eb48cab2500c9f2f67a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.987506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50517675aec4eb48cab2500c9f2f67a'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:14.999467 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1354/2726] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:14 2021] DELETE /identity/v3/users/b50517675aec4eb48cab2500c9f2f67a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:15.065124 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:15.066706 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:15.080553 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229ef7-a356-4e59-8ada-f629dbafa345 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:15.141017 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:15.141893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:15.142182 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:15.142466 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] PATH_INFO: `/v3/projects/1c1b1a7c2444474d9ccca2ccda05de16` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:15.143681 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1b1a7c2444474d9ccca2ccda05de16)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:15.145649 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:15.256560 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1b1a7c2444474d9ccca2ccda05de16', 'request_id': 'req-05ccdecb-2ee8-4778-82ef-eda01d323c7e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.262347 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1b1a7c2444474d9ccca2ccda05de16', 'request_id': 'req-05ccdecb-2ee8-4778-82ef-eda01d323c7e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.269151 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1b1a7c2444474d9ccca2ccda05de16', 'request_id': 'req-05ccdecb-2ee8-4778-82ef-eda01d323c7e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.328942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] The token cache is being invalidate because project 1c1b1a7c2444474d9ccca2ccda05de16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:15.329504 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.330202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.331728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1373/2727] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:15 2021] DELETE /identity/v3/projects/1c1b1a7c2444474d9ccca2ccda05de16 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:15.335696 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:15.337162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:15.349590 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9ca7c-262d-4263-84be-9cae8f28b241 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:15.418090 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:15.419603 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:15.420129 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:15.420832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] PATH_INFO: `/v3/users/771bbff052bf4abb8d143c401fb77049` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:15.422946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] RBAC: Authorizing `identity:delete_user(user_id=771bbff052bf4abb8d143c401fb77049)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:15.426523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:15.463626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:15.464101 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:15.478134 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccdecb-2ee8-4778-82ef-eda01d323c7e admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:15.482857 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:15.483711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:15.483988 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:15.484306 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] PATH_INFO: `/v3/projects/0ca3f5afdf004d9691926f7a2030b20d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:15.485546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca3f5afdf004d9691926f7a2030b20d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:15.487723 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:15.611196 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771bbff052bf4abb8d143c401fb77049'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.611891 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771bbff052bf4abb8d143c401fb77049'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.612575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771bbff052bf4abb8d143c401fb77049'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.615296 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca3f5afdf004d9691926f7a2030b20d', 'request_id': 'req-1c8f2b8f-fca1-4818-81c8-f55030b00385'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.620751 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca3f5afdf004d9691926f7a2030b20d', 'request_id': 'req-1c8f2b8f-fca1-4818-81c8-f55030b00385'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.627527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca3f5afdf004d9691926f7a2030b20d', 'request_id': 'req-1c8f2b8f-fca1-4818-81c8-f55030b00385'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.700247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771bbff052bf4abb8d143c401fb77049'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.712702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771bbff052bf4abb8d143c401fb77049'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.726202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1355/2728] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:15 2021] DELETE /identity/v3/users/771bbff052bf4abb8d143c401fb77049 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:15.787319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] The token cache is being invalidate because project 0ca3f5afdf004d9691926f7a2030b20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:15.787609 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.788570 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:15.790119 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1374/2729] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:15 2021] DELETE /identity/v3/projects/0ca3f5afdf004d9691926f7a2030b20d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:15.794245 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:15.795738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:15.858749 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a891-d5bf-4abc-823f-5afb9981238c admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:15.863910 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:15.871484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:15.871484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:15.871484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] PATH_INFO: `/v3/users/9a2ef1a9d494407b8350b1d59ceccffb` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:15.871484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2ef1a9d494407b8350b1d59ceccffb)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:15.871484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:16.024510 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2ef1a9d494407b8350b1d59ceccffb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.025681 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2ef1a9d494407b8350b1d59ceccffb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.026448 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2ef1a9d494407b8350b1d59ceccffb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.095933 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2ef1a9d494407b8350b1d59ceccffb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.108237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a919b324-df8f-409c-a0fa-3f7ae84e2b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2ef1a9d494407b8350b1d59ceccffb'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.121489 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1356/2730] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:15 2021] DELETE /identity/v3/users/9a2ef1a9d494407b8350b1d59ceccffb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:16.139912 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:16.141600 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:16.212160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2b8f-fca1-4818-81c8-f55030b00385 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:16.269350 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:16.270154 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.270436 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.270712 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] PATH_INFO: `/v3/projects/06535500cca84b369be629f7e5c0699d` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.271911 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06535500cca84b369be629f7e5c0699d)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:16.273882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:16.382483 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06535500cca84b369be629f7e5c0699d', 'request_id': 'req-3e136608-05e4-4202-afe6-ff2fe8af469c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.387942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06535500cca84b369be629f7e5c0699d', 'request_id': 'req-3e136608-05e4-4202-afe6-ff2fe8af469c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.394174 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06535500cca84b369be629f7e5c0699d', 'request_id': 'req-3e136608-05e4-4202-afe6-ff2fe8af469c'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.473069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] The token cache is being invalidate because project 06535500cca84b369be629f7e5c0699d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:16.473765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.473972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3e136608-05e4-4202-afe6-ff2fe8af469c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.475510 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1375/2731] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:16 2021] DELETE /identity/v3/projects/06535500cca84b369be629f7e5c0699d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:16.481342 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.481632 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.481909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.501100 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:16.505365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:16.557536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1357/2732] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:16.565523 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.565825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.566110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.584748 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:16.585942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:16.594586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1376/2733] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:16.598806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:16.605660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:16.607297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:16.608801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef47adb-12cb-4bb5-8b9d-42e2a49b1098 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:16.613850 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:16.614518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.614805 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.615158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.615790 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:34:16.616097 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:16.617719 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:16.620487 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eddcb-b6a2-4c70-aa75-bd9aa4c2ac9f None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:16.625405 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:16.626587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.626780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.627060 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] PATH_INFO: `/v3/projects/c9b2a9b8c8424768b3a69d402eeb06b5` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.628402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b2a9b8c8424768b3a69d402eeb06b5)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:16.629998 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1358/2734] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:34:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 22:34:16.630399 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:16.634576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:16.647786 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653add7-9373-4d43-bd43-abf2ff048bb9 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:16.653324 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:16.654462 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.654825 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.655203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.656793 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:16.658814 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:16.759058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b2a9b8c8424768b3a69d402eeb06b5', 'request_id': 'req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.764277 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b2a9b8c8424768b3a69d402eeb06b5', 'request_id': 'req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.770951 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b2a9b8c8424768b3a69d402eeb06b5', 'request_id': 'req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.775459 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1359/2735] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:16 2021] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:16.776481 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:16.837379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331de61a-0410-4cb4-89c7-c09907243c54 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:16.841992 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:16.842650 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:16.842936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:16.843237 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:16.843913 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:16.845836 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:16.855013 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] The token cache is being invalidate because project c9b2a9b8c8424768b3a69d402eeb06b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:16.855335 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.855968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:16.857531 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1377/2736] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:16 2021] DELETE /identity/v3/projects/c9b2a9b8c8424768b3a69d402eeb06b5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:16.933642 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1360/2737] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:16 2021] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:16.934869 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:16.936303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:17.003078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b4e6e-0e97-40e1-8e54-ef133d909cbe admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.007883 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.008603 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.008895 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.009173 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.009955 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.011566 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.025975 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1378/2738] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:16 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:17.027203 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.037748 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89783848-bdba-4e55-88ec-2be58773b1be admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.042449 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf86233-ebb8-46ce-8f86-49c335f0f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.043128 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf86233-ebb8-46ce-8f86-49c335f0f467 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.043408 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf86233-ebb8-46ce-8f86-49c335f0f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.043707 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf86233-ebb8-46ce-8f86-49c335f0f467 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.044470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf86233-ebb8-46ce-8f86-49c335f0f467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.046072 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf86233-ebb8-46ce-8f86-49c335f0f467 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.059946 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1361/2739] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:17.061485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.072295 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f28a5-b68c-40c2-8594-6da6b47fafd6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.077040 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.078546 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.078834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.079114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] PATH_INFO: `/v3/projects/bd025036cdec4643b052cd34617e16c3/users/f5631441f6d8456bba618755dba6fbba/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.095401 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd025036cdec4643b052cd34617e16c3, user_id=f5631441f6d8456bba618755dba6fbba, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.098078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.209204 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1379/2740] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:17 2021] PUT /identity/v3/projects/bd025036cdec4643b052cd34617e16c3/users/f5631441f6d8456bba618755dba6fbba/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:17.220134 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.221402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.221402 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.250926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] MFA Rules not processed for user `f5631441f6d8456bba618755dba6fbba`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:17.252149 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:17.315877 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1362/2741] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:17 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:17.320316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.380457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869b3aa-42f2-441c-9b70-411812fe9f0b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.385176 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.385843 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.386138 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.386419 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.387110 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.389071 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.417870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.419315 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:17.478043 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f1aa-9851-4fff-b033-51bb18ab75c6 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.481741 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.482390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.482676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.482956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.485254 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:17.514122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1380/2742] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:17 2021] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:34:17.532820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.545148 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.547138 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.557091 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1363/2743] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:17 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:34:17.593754 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649af71-e6f9-4c92-a881-52dd9569426f admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.598614 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.599336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.599615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.599893 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.600665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.602707 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.722812 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1381/2744] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:17 2021] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:17.724011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.734822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbe878-c2b7-45ee-9962-0c6ed6f3d144 service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.739813 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.740516 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.740806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.741087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.741823 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.743426 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.757244 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1364/2745] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:17.758749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.768743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c08b-4837-498d-919e-e5fc814efae5 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.773567 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.774529 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.774884 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.775233 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] PATH_INFO: `/v3/projects/1b5b73b18442443fa7d1ba0e56f03553/users/bf658836c3f64ebea8fec2ee2ecc053e/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.790682 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5b73b18442443fa7d1ba0e56f03553, user_id=bf658836c3f64ebea8fec2ee2ecc053e, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.793357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.844676 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1382/2746] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:17 2021] PUT /identity/v3/projects/1b5b73b18442443fa7d1ba0e56f03553/users/bf658836c3f64ebea8fec2ee2ecc053e/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:17.848752 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.859581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754bd3b-8727-4c4c-912f-0e9cf82fffe5 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.914859 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a02d3d-4a70-4199-943a-a20c61e9f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.915547 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02d3d-4a70-4199-943a-a20c61e9f62a admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.915835 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02d3d-4a70-4199-943a-a20c61e9f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.916119 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02d3d-4a70-4199-943a-a20c61e9f62a admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.917015 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a02d3d-4a70-4199-943a-a20c61e9f62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.919180 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a02d3d-4a70-4199-943a-a20c61e9f62a admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.930695 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1365/2747] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:17 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:17.935087 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:17.945655 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f3b8-bd2e-47c7-8e1c-acbc54150b82 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:17.950380 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:17.951262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.951548 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.951828 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] PATH_INFO: `/v3/projects/1b5b73b18442443fa7d1ba0e56f03553/users/bf658836c3f64ebea8fec2ee2ecc053e/roles/ea69f9c310e340ff88a42ee56ce63ff0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:17.954334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5b73b18442443fa7d1ba0e56f03553, user_id=bf658836c3f64ebea8fec2ee2ecc053e, role_id=ea69f9c310e340ff88a42ee56ce63ff0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:17.956992 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:17.967292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1383/2748] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:17 2021] PUT /identity/v3/projects/1b5b73b18442443fa7d1ba0e56f03553/users/bf658836c3f64ebea8fec2ee2ecc053e/roles/ea69f9c310e340ff88a42ee56ce63ff0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:17.982612 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:17.982915 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:17.983202 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:18.011623 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] MFA Rules not processed for user `bf658836c3f64ebea8fec2ee2ecc053e`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:18.012855 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:18.078316 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1366/2749] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:17 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:18.088495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:18.090156 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:18.146410 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b32b-2268-445c-9e5e-6ffb2765610b admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:18.150316 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:18.151012 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:18.151299 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:18.151583 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:18.161388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:18.162818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:18.172293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1384/2750] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:18 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:18.299944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:18.301384 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:18.313648 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5186fc-4122-4a7a-a434-d362fcb89468 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:18.318876 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b8f5f-e863-4750-9f0a-b98b790018ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:18.319533 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b8f5f-e863-4750-9f0a-b98b790018ed service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:18.319821 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b8f5f-e863-4750-9f0a-b98b790018ed service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:18.320099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b8f5f-e863-4750-9f0a-b98b790018ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:18.374756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b8f5f-e863-4750-9f0a-b98b790018ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:18.376213 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b8f5f-e863-4750-9f0a-b98b790018ed service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:18.385030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1367/2751] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:18 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:23.032942 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:23.092172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e01c2-8cef-49ad-836e-24d79d365280 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:23.097218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:23.098075 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:23.098358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:23.098633 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] PATH_INFO: `/v3/users/f5631441f6d8456bba618755dba6fbba` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:23.099799 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5631441f6d8456bba618755dba6fbba)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:23.101733 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:23.256848 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5631441f6d8456bba618755dba6fbba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:23.312105 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5631441f6d8456bba618755dba6fbba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:23.323432 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5631441f6d8456bba618755dba6fbba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:23.330673 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5631441f6d8456bba618755dba6fbba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:23.331328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5631441f6d8456bba618755dba6fbba'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:23.337127 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1385/2752] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:23 2021] DELETE /identity/v3/users/f5631441f6d8456bba618755dba6fbba => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:23.341870 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:23.342413 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:23.342536 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:23.359911 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:23.361372 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:23.417562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1368/2753] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:34:23.427765 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:23.429157 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:23.488331 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607195-82aa-423b-859f-3e5518ef2212 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:23.492238 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:23.492889 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:23.493177 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:23.493454 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:23.503106 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:23.504537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:23.513930 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1386/2754] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:23.919693 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:23.921192 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:23.939465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cead-b472-41f5-8cc3-3b629f758a10 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:23.940412 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:23.941293 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:23.941577 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:23.941853 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] PATH_INFO: `/v3/projects/bd025036cdec4643b052cd34617e16c3` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:23.943022 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd025036cdec4643b052cd34617e16c3)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:23.945826 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:24.048456 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd025036cdec4643b052cd34617e16c3', 'request_id': 'req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.053700 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd025036cdec4643b052cd34617e16c3', 'request_id': 'req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.059576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd025036cdec4643b052cd34617e16c3', 'request_id': 'req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.128634 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] The token cache is being invalidate because project bd025036cdec4643b052cd34617e16c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:24.128927 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.129529 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.131087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1369/2755] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:23 2021] DELETE /identity/v3/projects/bd025036cdec4643b052cd34617e16c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:24.135096 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:24.144628 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584607b-a603-497a-8466-5920f1072cc3 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:24.199149 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:24.200011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:24.200303 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:24.200690 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] PATH_INFO: `/v3/users/bf658836c3f64ebea8fec2ee2ecc053e` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:24.201894 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf658836c3f64ebea8fec2ee2ecc053e)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:24.203929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:24.388336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf658836c3f64ebea8fec2ee2ecc053e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.477323 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf658836c3f64ebea8fec2ee2ecc053e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.490164 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf658836c3f64ebea8fec2ee2ecc053e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.496871 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf658836c3f64ebea8fec2ee2ecc053e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.497503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-8356b623-b2c0-40b9-8d00-2f9166d39bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf658836c3f64ebea8fec2ee2ecc053e'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:24.503440 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1387/2756] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:24 2021] DELETE /identity/v3/users/bf658836c3f64ebea8fec2ee2ecc053e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:25.117114 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.118562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:25.131645 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c3b5-8a54-4ed1-b92b-baf07c0cb588 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.198039 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.198899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.199179 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.199454 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] PATH_INFO: `/v3/projects/1b5b73b18442443fa7d1ba0e56f03553` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.200656 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5b73b18442443fa7d1ba0e56f03553)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.203261 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:25.317638 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5b73b18442443fa7d1ba0e56f03553', 'request_id': 'req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:25.322839 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5b73b18442443fa7d1ba0e56f03553', 'request_id': 'req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:25.329434 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5b73b18442443fa7d1ba0e56f03553', 'request_id': 'req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:25.420517 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] The token cache is being invalidate because project 1b5b73b18442443fa7d1ba0e56f03553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:25.420815 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:25.422003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-a2aa65e5-e07f-43b6-bc0e-9ff8ff842795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:25.423588 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1370/2757] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:25 2021] DELETE /identity/v3/projects/1b5b73b18442443fa7d1ba0e56f03553 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:25.429481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.429984 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.430172 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.447829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:25.449031 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:25.506114 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1388/2758] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:25.514187 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.514480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.514766 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.533173 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:25.538064 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:25.546055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1371/2759] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:25.553937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.560986 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a414f-2f7c-4124-b45a-4ee3ddf71b44 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.566281 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.566943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.567239 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.567543 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.568355 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:34:25.568651 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.570321 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:25.581915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1389/2760] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:34:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:34:25.586934 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.596390 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90bbd0-122e-4596-9296-ef31ebe5d524 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.601198 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.601851 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.602226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.602556 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.603247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.605284 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:25.702659 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1372/2761] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:25 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:25.706915 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.716767 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6ab0-a82b-4448-9969-062505780f63 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.770334 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.771035 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.771336 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.771615 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.772313 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.774298 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:25.872804 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1390/2762] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:25 2021] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:25.876809 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.887003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ae04a-723e-459c-813b-3f3034aec126 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.891669 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.892323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.892643 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.892923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.893641 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.895225 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:25.905255 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1373/2763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:25.909752 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.919431 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e13e4b-154a-434a-8a2d-d5051c307af6 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.924737 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514948b-4248-45fa-b161-cf22a9aa496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.925388 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514948b-4248-45fa-b161-cf22a9aa496e admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.925672 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514948b-4248-45fa-b161-cf22a9aa496e admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.925947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514948b-4248-45fa-b161-cf22a9aa496e admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.926663 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514948b-4248-45fa-b161-cf22a9aa496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.928214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514948b-4248-45fa-b161-cf22a9aa496e admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:25.938185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1391/2764] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:34:25.941952 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:25.951485 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6df09-0b61-442d-aa57-daaca85f086b admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:25.956013 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:25.956902 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:25.957188 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:25.957465 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] PATH_INFO: `/v3/projects/6f95d10653934ee2af2e1a5cdbb5a092/users/cf63eeae653b41129fe8438d48f7d8e5/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:25.971697 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f95d10653934ee2af2e1a5cdbb5a092, user_id=cf63eeae653b41129fe8438d48f7d8e5, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:25.974363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:26.043279 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1374/2765] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:25 2021] PUT /identity/v3/projects/6f95d10653934ee2af2e1a5cdbb5a092/users/cf63eeae653b41129fe8438d48f7d8e5/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:26.055122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:26.055418 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:26.055705 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:26.082328 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] MFA Rules not processed for user `cf63eeae653b41129fe8438d48f7d8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:26.083524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:26.144524 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1392/2766] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:26 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:26.154498 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:26.156735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:26.211036 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0a092-fbcd-4805-8274-537a856e6ea0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:26.214704 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc56224-aca7-4222-9e77-d0e804c60c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:26.215342 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc56224-aca7-4222-9e77-d0e804c60c67 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:26.215633 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc56224-aca7-4222-9e77-d0e804c60c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:26.215914 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc56224-aca7-4222-9e77-d0e804c60c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:26.224591 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc56224-aca7-4222-9e77-d0e804c60c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:26.226030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc56224-aca7-4222-9e77-d0e804c60c67 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:26.237569 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1375/2767] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:26 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:26.253363 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:26.312787 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff74ef-d3cc-4937-b16b-f4686edd233e None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:26.317443 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:26.318297 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:26.318611 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:26.318892 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] PATH_INFO: `/v3/users/cf63eeae653b41129fe8438d48f7d8e5` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:26.320084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf63eeae653b41129fe8438d48f7d8e5)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:26.322032 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:26.513963 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf63eeae653b41129fe8438d48f7d8e5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:26.591292 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf63eeae653b41129fe8438d48f7d8e5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:26.602861 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf63eeae653b41129fe8438d48f7d8e5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:26.610479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf63eeae653b41129fe8438d48f7d8e5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:26.610479 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf63eeae653b41129fe8438d48f7d8e5'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:26.618103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1393/2768] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:26 2021] DELETE /identity/v3/users/cf63eeae653b41129fe8438d48f7d8e5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:26.620996 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:26.621301 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:26.621564 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:26.638763 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:26.639942 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:26.694519 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1376/2769] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:26.704069 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:26.706135 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:26.759503 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c523f-aefb-4a93-9f13-1a6551de90cb admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:26.763098 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ace4-e7d3-44cb-bdbd-f8fbab5c8b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:26.763732 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ace4-e7d3-44cb-bdbd-f8fbab5c8b8d service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:26.764016 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ace4-e7d3-44cb-bdbd-f8fbab5c8b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:26.764289 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ace4-e7d3-44cb-bdbd-f8fbab5c8b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:26.773429 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ace4-e7d3-44cb-bdbd-f8fbab5c8b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:26.774831 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ace4-e7d3-44cb-bdbd-f8fbab5c8b8d service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:26.783820 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1394/2770] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 22:34:27.210921 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.212332 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:27.224014 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5242aaf-c67e-4fab-82ee-42d04d8d7f62 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.228935 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.229811 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.230158 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.230374 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] PATH_INFO: `/v3/projects/6f95d10653934ee2af2e1a5cdbb5a092` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.231562 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f95d10653934ee2af2e1a5cdbb5a092)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:27.233518 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:27.390214 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f95d10653934ee2af2e1a5cdbb5a092', 'request_id': 'req-dc1ef9bc-2588-446e-bce8-80abbf678fd9'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:27.395378 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f95d10653934ee2af2e1a5cdbb5a092', 'request_id': 'req-dc1ef9bc-2588-446e-bce8-80abbf678fd9'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:27.401367 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f95d10653934ee2af2e1a5cdbb5a092', 'request_id': 'req-dc1ef9bc-2588-446e-bce8-80abbf678fd9'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:27.476750 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] The token cache is being invalidate because project 6f95d10653934ee2af2e1a5cdbb5a092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:27.477044 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:27.477684 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-dc1ef9bc-2588-446e-bce8-80abbf678fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:27.479460 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1377/2771] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:27 2021] DELETE /identity/v3/projects/6f95d10653934ee2af2e1a5cdbb5a092 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:27.487882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.487882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.487882 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.503791 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:27.505010 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:27.560997 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1395/2772] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:34:27.568738 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.569069 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.569358 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.587032 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:27.588258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:27.596548 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1378/2773] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:27.600527 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.609866 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78880-6bdb-420c-8dd3-df0ea1908dbf None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.615437 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.616092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.616381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.616698 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.617420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73764) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:34:27.617736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:27.619314 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:27.630446 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1396/2774] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:34:27.634436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.643822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1acc-93d1-4c80-9955-7835c5f45b64 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.648355 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.649018 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.649300 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.649576 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.650285 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:27.652151 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:27.725506 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1379/2775] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:27 2021] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:34:27.729626 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.739743 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1822dc-b88c-4e49-9055-a427f3ce11c1 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.794593 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.795270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.795579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.795881 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] PATH_INFO: `/v3/users` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.796586 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:27.798533 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:27.901579 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1397/2776] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:27 2021] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 22:34:27.905575 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.916629 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730e2a-25e1-447d-8818-743743bc7ab0 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.921323 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.921984 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.922278 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.922541 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.923260 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:27.924866 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:27.934901 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1380/2777] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:27.939006 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.948932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e86030-56da-4b5b-a04a-971d9d234859 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.953670 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f5159-e814-46c5-a4d1-22b351b6ae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.954357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5159-e814-46c5-a4d1-22b351b6ae38 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.955185 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5159-e814-46c5-a4d1-22b351b6ae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.955471 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5159-e814-46c5-a4d1-22b351b6ae38 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:27.956202 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f5159-e814-46c5-a4d1-22b351b6ae38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:27.957829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f5159-e814-46c5-a4d1-22b351b6ae38 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:27.967495 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1398/2778] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 22:34:27.972270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:27.982258 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c920-c9de-423f-8765-1f31f81bd691 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:27.987438 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:27.993581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:27.993581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:27.993581 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] PATH_INFO: `/v3/projects/b632107ff61a4724a52cafb9bbf48b64/users/49a674cce51d4a97ace996a2d39493cc/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:28.003539 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b632107ff61a4724a52cafb9bbf48b64, user_id=49a674cce51d4a97ace996a2d39493cc, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:28.006311 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:28.089544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1381/2779] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:27 2021] PUT /identity/v3/projects/b632107ff61a4724a52cafb9bbf48b64/users/49a674cce51d4a97ace996a2d39493cc/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:28.100968 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf2d0-7233-4614-9b3c-37170ab179a7 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:28.101262 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf2d0-7233-4614-9b3c-37170ab179a7 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:28.101541 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf2d0-7233-4614-9b3c-37170ab179a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:28.127656 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-68adf2d0-7233-4614-9b3c-37170ab179a7 None None] MFA Rules not processed for user `49a674cce51d4a97ace996a2d39493cc`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:28.128891 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-68adf2d0-7233-4614-9b3c-37170ab179a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:28.188711 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1399/2780] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:28 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:28.199037 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:28.200727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:28.256573 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8f53-ef72-48b2-a92a-c6e54306aa83 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:28.260184 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b80d4-2189-4f56-a4c5-8e9e3c6fe4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:28.260868 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b80d4-2189-4f56-a4c5-8e9e3c6fe4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:28.261147 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b80d4-2189-4f56-a4c5-8e9e3c6fe4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:28.261422 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b80d4-2189-4f56-a4c5-8e9e3c6fe4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:28.270070 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b80d4-2189-4f56-a4c5-8e9e3c6fe4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:28.271480 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b80d4-2189-4f56-a4c5-8e9e3c6fe4f3 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:28.279936 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1382/2781] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:28 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:29.967450 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:29.967949 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:29.968062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:29.984937 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] MFA Rules not processed for user `49a674cce51d4a97ace996a2d39493cc`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:29.986616 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:29.993346 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1400/2782] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:29 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:45.160982 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e81cb-77e5-4a5f-a33e-bf2e256e7192 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:45.164965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e81cb-77e5-4a5f-a33e-bf2e256e7192 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:45.164965 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e81cb-77e5-4a5f-a33e-bf2e256e7192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:45.179773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-719e81cb-77e5-4a5f-a33e-bf2e256e7192 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:45.180997 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-719e81cb-77e5-4a5f-a33e-bf2e256e7192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:45.237673 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1383/2783] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:34:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:45.246537 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:45.247933 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:45.313870 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1adb51-219c-406d-99a5-5568da4c57ec None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:45.318823 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:45.319972 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:45.320260 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:45.320574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:45.328280 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:45.329876 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:45.338162 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1401/2784] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:34:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 22:34:46.597345 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467bd00-ac72-489b-95de-da3e22628c88 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:46.597882 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467bd00-ac72-489b-95de-da3e22628c88 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:46.597985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467bd00-ac72-489b-95de-da3e22628c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:46.615647 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-a467bd00-ac72-489b-95de-da3e22628c88 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:46.616899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-a467bd00-ac72-489b-95de-da3e22628c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:46.624040 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1384/2785] 10.222.0.20 () {58 vars in 1010 bytes} [Tue Sep 14 22:34:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:46.636991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:46.647420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee1e0-8714-43e9-a200-3875a5139005 service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:46.653066 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:46.653703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:46.653991 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:46.654273 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:46.662103 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:46.663660 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:46.671481 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1402/2786] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:34:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 22:34:47.250430 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:47.250728 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:47.251005 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:47.268744 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] MFA Rules not processed for user `3265f9ac013c4416ab06bdbdf73bed81`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:47.269923 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:47.277164 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1385/2787] 10.222.0.20 () {58 vars in 968 bytes} [Tue Sep 14 22:34:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:47.289221 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:47.299569 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448387aa-cdad-4780-899e-6c7a0a931c82 service swift] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:47.304793 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc90a7-91ec-494d-a51a-2776dcce709b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ff32dae4784d4398bd57d5bd03aaa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:47.305957 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc90a7-91ec-494d-a51a-2776dcce709b service swift] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:47.306242 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc90a7-91ec-494d-a51a-2776dcce709b service swift] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:47.306519 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc90a7-91ec-494d-a51a-2776dcce709b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:47.314485 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc90a7-91ec-494d-a51a-2776dcce709b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:47.316077 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc90a7-91ec-494d-a51a-2776dcce709b service swift] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:47.324547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1403/2788] 10.222.0.20 () {60 vars in 1385 bytes} [Tue Sep 14 22:34:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 22:34:49.835030 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:49.893822 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d80e-e175-4597-86d9-744c90956e96 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:49.898209 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:49.899055 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:49.899344 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:49.899614 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] PATH_INFO: `/v3/users/49a674cce51d4a97ace996a2d39493cc` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:49.900856 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a674cce51d4a97ace996a2d39493cc)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:49.903224 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:50.066365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a674cce51d4a97ace996a2d39493cc'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.066999 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a674cce51d4a97ace996a2d39493cc'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.067592 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a674cce51d4a97ace996a2d39493cc'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.135009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a674cce51d4a97ace996a2d39493cc'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.146162 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a674cce51d4a97ace996a2d39493cc'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.158226 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1386/2789] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:34:49 2021] DELETE /identity/v3/users/49a674cce51d4a97ace996a2d39493cc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:50.162759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.163251 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.163358 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.180759 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:50.181935 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:50.239376 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1404/2790] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:34:50.249003 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:50.250363 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:50.305011 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16fb0-3725-4665-a44e-af78f773c003 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:50.308665 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611400f6-83ae-466d-94e8-641d12d862cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:50.309304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611400f6-83ae-466d-94e8-641d12d862cf service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.309584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611400f6-83ae-466d-94e8-641d12d862cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.309865 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611400f6-83ae-466d-94e8-641d12d862cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.318431 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611400f6-83ae-466d-94e8-641d12d862cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:50.319834 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611400f6-83ae-466d-94e8-641d12d862cf service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:50.329676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1387/2791] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:50.553687 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:50.555104 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:50.569011 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8b564-b26c-4b3b-be9d-afc4fc47efc6 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:50.574438 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:50.574788 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.575078 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.575357 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] PATH_INFO: `/v3/projects/b632107ff61a4724a52cafb9bbf48b64` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.576646 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b632107ff61a4724a52cafb9bbf48b64)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:50.578556 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:50.684322 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b632107ff61a4724a52cafb9bbf48b64', 'request_id': 'req-4de0b91c-7161-4ace-b48d-63e63579f621'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.690208 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b632107ff61a4724a52cafb9bbf48b64', 'request_id': 'req-4de0b91c-7161-4ace-b48d-63e63579f621'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.696807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b632107ff61a4724a52cafb9bbf48b64', 'request_id': 'req-4de0b91c-7161-4ace-b48d-63e63579f621'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.756929 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] The token cache is being invalidate because project b632107ff61a4724a52cafb9bbf48b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73764) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:34:50.757214 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.757821 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-4de0b91c-7161-4ace-b48d-63e63579f621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:34:50.759381 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1405/2792] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:34:50 2021] DELETE /identity/v3/projects/b632107ff61a4724a52cafb9bbf48b64 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:34:50.767009 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02f-8703-4385-b965-8abded348550 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.767309 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02f-8703-4385-b965-8abded348550 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.767593 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02f-8703-4385-b965-8abded348550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.785587 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-011dd02f-8703-4385-b965-8abded348550 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:50.786764 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-011dd02f-8703-4385-b965-8abded348550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:50.841985 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1388/2793] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 22:34:50.849934 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.850220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.850494 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.868770 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:50.869943 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:50.877689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1406/2794] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:50.881523 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02f-8703-4385-b965-8abded348550 None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:50.890745 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02f-8703-4385-b965-8abded348550 None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:50.895392 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:50.896076 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.896364 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.896676 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] PATH_INFO: `/v3/domains` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.897417 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 22:34:50.897727 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:50.899304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:50.910960 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1389/2795] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 14 22:34:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 22:34:50.915275 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:50.924909 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1b70a-a029-4eb6-bd60-49caffb8bd93 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:50.929728 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:50.930396 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:50.930679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:50.930953 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] PATH_INFO: `/v3/projects` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:50.931642 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:50.933595 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:51.033877 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1407/2796] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 14 22:34:50 2021] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:51.037818 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:51.047770 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21d03-5969-4849-9912-662179dd1074 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:51.100829 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:51.101495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:51.101806 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:51.102085 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] PATH_INFO: `/v3/users` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:51.102773 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:51.104733 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:51.174847 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1390/2797] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 14 22:34:51 2021] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 22:34:51.178993 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:51.189130 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728170b-4c53-4b57-8178-516285b93677 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:51.193845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:51.194547 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:51.194852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:51.195136 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] PATH_INFO: `/v3/roles` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:51.195978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:51.197664 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:51.208818 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1408/2798] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:51.212294 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:51.222971 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78743a-0484-4199-a3f5-b2f2a44823bb admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:51.227607 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb1c1f-34d0-4f91-9ed5-b4be65aaeb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:51.228256 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb1c1f-34d0-4f91-9ed5-b4be65aaeb39 admin admin] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:51.228574 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb1c1f-34d0-4f91-9ed5-b4be65aaeb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:51.228858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb1c1f-34d0-4f91-9ed5-b4be65aaeb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:51.229611 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb1c1f-34d0-4f91-9ed5-b4be65aaeb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:51.231204 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb1c1f-34d0-4f91-9ed5-b4be65aaeb39 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:51.241349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1391/2799] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 14 22:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 22:34:51.245528 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:51.255525 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381618-f7c7-44fd-8e8b-7becf999c280 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:51.260220 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:51.261141 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] REQUEST_METHOD: `PUT` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:51.261428 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:51.262270 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] PATH_INFO: `/v3/projects/03bff341adb5460099b4b9a84fc3f42c/users/a709ecaca3bb4c3190c49d4a4626f1de/roles/97fea09c5d2643c08c6c753c1392de1b` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:51.276544 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bff341adb5460099b4b9a84fc3f42c, user_id=a709ecaca3bb4c3190c49d4a4626f1de, role_id=97fea09c5d2643c08c6c753c1392de1b)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:51.280255 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:51.346689 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1409/2800] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 14 22:34:51 2021] PUT /identity/v3/projects/03bff341adb5460099b4b9a84fc3f42c/users/a709ecaca3bb4c3190c49d4a4626f1de/roles/97fea09c5d2643c08c6c753c1392de1b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:34:51.351990 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b622c01-5835-45d0-a873-bc1e08073fd2 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:51.352282 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b622c01-5835-45d0-a873-bc1e08073fd2 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:51.352594 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b622c01-5835-45d0-a873-bc1e08073fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:51.370116 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-1b622c01-5835-45d0-a873-bc1e08073fd2 None None] MFA Rules not processed for user `ff904f2428954da5908fbaf5fc605dce`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:51.371808 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-1b622c01-5835-45d0-a873-bc1e08073fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:51.425801 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1392/2801] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:51.435852 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:51.437605 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:51.491594 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2cd3-cfa2-48ef-beaa-f6a51c367cef admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:51.495312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:51.496499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:51.496807 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:51.497084 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:51.506102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:51.507384 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:51.517291 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1410/2802] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:52.831049 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d3e7-6ced-4ec8-9015-8ccc593280e5 None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:52.832156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d3e7-6ced-4ec8-9015-8ccc593280e5 None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:52.832156 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d3e7-6ced-4ec8-9015-8ccc593280e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:52.859326 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7bb3d3e7-6ced-4ec8-9015-8ccc593280e5 None None] MFA Rules not processed for user `a709ecaca3bb4c3190c49d4a4626f1de`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:52.860708 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7bb3d3e7-6ced-4ec8-9015-8ccc593280e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:52.923165 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1393/2803] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:52 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:34:52.933294 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:34:52.935319 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:52.991160 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01bce-5fef-4edc-a544-354d700fc934 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:34:52.994851 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:34:52.995499 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:52.995786 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:52.996065 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:53.004703 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:34:53.006117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:34:53.015345 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1411/2804] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:34:52 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:34:54.663219 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] REQUEST_METHOD: `POST` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:34:54.663709 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:34:54.663828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:34:54.680944 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.auth.core [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] MFA Rules not processed for user `a709ecaca3bb4c3190c49d4a4626f1de`. Rule list: `[]` (Enabled: `True`). {{(pid=73765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:34:54.682130 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:34:54.688966 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1394/2805] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:34:54 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:35:28.870817 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:35:28.872218 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:35:28.882947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518f353-3043-4fef-b7cb-16ef31b893b8 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:35:28.886761 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:35:28.887404 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:35:28.887688 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:35:28.887964 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:35:28.889679 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:35:28.956686 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:35:28.958092 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:35:28.969276 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1412/2806] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:35:28 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:35:54.078495 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:35:54.087702 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e23ef-e410-43ef-9f2f-da95497de2ba None None] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:35:54.091229 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc75144a14f943a7adcb56dfdb808ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:35:54.091858 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:35:54.092155 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:35:54.092534 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:35:54.094248 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:35:54.107050 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:35:54.108511 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:35:54.119308 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1395/2807] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:35:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:35:58.215819 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:35:58.219931 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:35:58.238693 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fedb0-7b05-459e-9de7-3cc32f22d4c1 service cinder] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:35:58.246514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:35:58.247227 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:35:58.247513 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:35:58.247792 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:35:58.249662 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:35:58.263153 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:35:58.265735 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1029789-027a-4780-b770-19f0f1bab6d1 service nova] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:35:58.277033 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1413/2808] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:35:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:35:59.377365 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:35:59.387909 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd9fa6-d31b-47c5-8bfd-6c611577fdf6 service cinder] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:35:59.393470 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:35:59.394057 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:35:59.394342 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:35:59.394618 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:35:59.396482 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:35:59.406756 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:35:59.411206 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:35:59.416542 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1396/2809] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:35:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:36:09.524484 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] REQUEST_METHOD: `POST` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:09.524978 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:09.525117 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:09.542473 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.auth.core [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] MFA Rules not processed for user `a709ecaca3bb4c3190c49d4a4626f1de`. Rule list: `[]` (Enabled: `True`). {{(pid=73764) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 22:36:09.543683 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:09.551402 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1414/2810] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 14 22:36:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 22:36:10.155974 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:10.157436 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:10.223099 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c0fa-15f3-4f63-80cd-0e87b26db60f service neutron] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:10.228058 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:10.228732 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:10.229019 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:10.229295 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:10.231062 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:10.243159 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:10.244757 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:10.255273 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1397/2811] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:36:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:36:18.735850 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:18.746312 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36750-1f4a-48b2-accf-cb4e90fa1d56 None None] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:18.749901 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23bd8a1b9c4a1793742ea53c56b0ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:18.750540 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:18.750825 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:18.751102 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:18.753352 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:18.765112 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:18.766634 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:18.777064 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1415/2812] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:36:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:36:21.340687 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:21.354304 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4d48-4012-4f1e-9fde-406269c245a8 service placement] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:21.360016 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f86a734b484993a795bb8313400e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:21.360722 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] REQUEST_METHOD: `GET` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:21.361004 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:21.361320 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:21.363552 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:21.375945 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:21.377596 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:21.392544 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1398/2813] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:36:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 22:36:26.424344 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:26.425859 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:26.438007 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e017041-ed7c-4d51-838b-e5e3a80eb593 service neutron] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:26.442736 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:26.443602 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:26.443888 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:26.444168 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] PATH_INFO: `/v3/users/0685182b9a2f48b89f8198ab861214e0` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:26.445514 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0685182b9a2f48b89f8198ab861214e0)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:26.447474 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:26.672587 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0685182b9a2f48b89f8198ab861214e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:26.744665 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0685182b9a2f48b89f8198ab861214e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:26.756879 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0685182b9a2f48b89f8198ab861214e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:26.763420 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0685182b9a2f48b89f8198ab861214e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:26.764062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0685182b9a2f48b89f8198ab861214e0'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:26.770361 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1416/2814] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:36:26 2021] DELETE /identity/v3/users/0685182b9a2f48b89f8198ab861214e0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:36:27.004157 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:27.017832 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005ab7-3a8b-4bef-abab-328aae4b78f2 service nova] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:27.070893 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:27.076735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:27.076735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:27.076735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] PATH_INFO: `/v3/projects/85d8c4df46ab43c298282acae2b43512` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:27.076735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d8c4df46ab43c298282acae2b43512)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:27.076735 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:27.177484 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d8c4df46ab43c298282acae2b43512', 'request_id': 'req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.182649 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d8c4df46ab43c298282acae2b43512', 'request_id': 'req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.188530 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d8c4df46ab43c298282acae2b43512', 'request_id': 'req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.275846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] The token cache is being invalidate because project 85d8c4df46ab43c298282acae2b43512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:36:27.280463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.280463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.280463 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1399/2815] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:36:27 2021] DELETE /identity/v3/projects/85d8c4df46ab43c298282acae2b43512 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:36:27.282457 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:27.283834 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:27.296811 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4316-75a4-4ce6-ac7e-23e34daf7c7c admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:27.350393 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:27.351268 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:27.351557 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:27.351836 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] PATH_INFO: `/v3/users/f68c7d3ce15148528ec0dab12ceb3cd3` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:27.353048 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68c7d3ce15148528ec0dab12ceb3cd3)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:27.354987 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:27.530947 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68c7d3ce15148528ec0dab12ceb3cd3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.630508 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68c7d3ce15148528ec0dab12ceb3cd3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.642574 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68c7d3ce15148528ec0dab12ceb3cd3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.649293 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68c7d3ce15148528ec0dab12ceb3cd3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.649932 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68c7d3ce15148528ec0dab12ceb3cd3'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:27.655772 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1417/2816] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:36:27 2021] DELETE /identity/v3/users/f68c7d3ce15148528ec0dab12ceb3cd3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 22:36:27.878027 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:36:27.879443 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:36:27.892063 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d446-61f7-4c4e-bcae-afc57f8f6ab1 admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:36:27.947093 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:36:27.947962 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:36:27.948247 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:36:27.948699 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] PATH_INFO: `/v3/projects/494dfcbdcf724dd381c87003750012a4` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:36:27.949899 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=494dfcbdcf724dd381c87003750012a4)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:36:27.951828 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:36:28.069270 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494dfcbdcf724dd381c87003750012a4', 'request_id': 'req-510e37e1-3d36-4a70-80df-a80117bb87ec'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:28.074387 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494dfcbdcf724dd381c87003750012a4', 'request_id': 'req-510e37e1-3d36-4a70-80df-a80117bb87ec'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:28.080846 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494dfcbdcf724dd381c87003750012a4', 'request_id': 'req-510e37e1-3d36-4a70-80df-a80117bb87ec'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:28.131950 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] The token cache is being invalidate because project 494dfcbdcf724dd381c87003750012a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:36:28.132178 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:28.132787 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:36:28.134340 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1400/2817] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:36:27 2021] DELETE /identity/v3/projects/494dfcbdcf724dd381c87003750012a4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:37:14.983148 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:37:14.984645 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:37:14.998301 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e608-2a1a-49d4-920a-d684fc40d6a0 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:37:15.052967 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:37:15.053835 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:37:15.054122 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:37:15.054650 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] PATH_INFO: `/v3/users/a709ecaca3bb4c3190c49d4a4626f1de` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:37:15.055845 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a709ecaca3bb4c3190c49d4a4626f1de)` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:37:15.057808 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:37:15.190534 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a709ecaca3bb4c3190c49d4a4626f1de'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.241058 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a709ecaca3bb4c3190c49d4a4626f1de'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.255486 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a709ecaca3bb4c3190c49d4a4626f1de'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.259055 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a709ecaca3bb4c3190c49d4a4626f1de'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.259677 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.notifications [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a709ecaca3bb4c3190c49d4a4626f1de'} {{(pid=73764) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.265374 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1418/2818] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 14 22:37:14 2021] DELETE /identity/v3/users/a709ecaca3bb4c3190c49d4a4626f1de => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:37:15.494083 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Authenticating user token {{(pid=73765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:37:15.495522 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.fernet_utils [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:37:15.509956 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e37e1-3d36-4a70-80df-a80117bb87ec admin admin] Validating token access rules against request {{(pid=73765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:37:15.565168 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff904f2428954da5908fbaf5fc605dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28134749d4e040b88a7f85c383c201c7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:37:15.566087 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:37:15.566889 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:37:15.567167 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] PATH_INFO: `/v3/projects/03bff341adb5460099b4b9a84fc3f42c` {{(pid=73765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:37:15.568349 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bff341adb5460099b4b9a84fc3f42c)` {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:37:15.570292 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] RBAC: Authorization granted {{(pid=73765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:37:15.674455 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bff341adb5460099b4b9a84fc3f42c', 'request_id': 'req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.679879 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bff341adb5460099b4b9a84fc3f42c', 'request_id': 'req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.685926 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bff341adb5460099b4b9a84fc3f42c', 'request_id': 'req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd'} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.731089 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] The token cache is being invalidate because project 03bff341adb5460099b4b9a84fc3f42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 22:37:15.731379 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.732010 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: DEBUG keystone.notifications [None req-5e4e4c1c-7ed1-481e-94c9-a4be041e30bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 22:37:15.733584 dv-cinder-808819-1-iscsi devstack@keystone.service[73765]: [pid: 73765|app: 0|req: 1401/2819] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 14 22:37:15 2021] DELETE /identity/v3/projects/03bff341adb5460099b4b9a84fc3f42c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 22:38:31.791062 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Authenticating user token {{(pid=73764) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 22:38:31.792378 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:38:31.921780 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2b4a-4a12-4774-b814-a70ce7600257 admin admin] Validating token access rules against request {{(pid=73764) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 22:38:31.976749 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5270a4882c43439489e806c1c15a2e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd23bf3fa5aa24998a1474108d98fd29d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73764) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 22:38:31.977516 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] REQUEST_METHOD: `GET` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 22:38:31.977806 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] SCRIPT_NAME: `/identity` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 22:38:31.978086 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73764) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 22:38:31.979829 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.fernet_utils [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73764) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 22:38:31.991022 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 22:38:31.992612 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ac7da-383f-4778-b3b3-7ceab5f4f1bc service placement] RBAC: Authorization granted {{(pid=73764) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 22:38:32.002161 dv-cinder-808819-1-iscsi devstack@keystone.service[73764]: [pid: 73764|app: 0|req: 1419/2820] 10.222.0.20 () {60 vars in 1366 bytes} [Tue Sep 14 22:38:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)